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(54) Driving-assist system 

(57) A driving assist system for assisting effort by an 
operator (10) to operate a vehicle in traveling is provid- 
ed. The driving assist system receives data (42) includ- 
ing information on vehicle state and Information on en- 
vironment in a field around the vehicle. A controller, 
mounted to the vehicle, determines future environment 
in the field (46), makes an operator response plan (50) 



in response to the determined future environment to de- 
termine command, and generates the command. The 
operator response plan prompts the operator (1 0) to op- 
erating the vehicle in a desired manner for the deter- 
mined future environment. At least one actuator (52), 
mounted to the vehicle, prompts the operator (10) in re- 
sponse to the command to operating the vehicle in the 
desired manner. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[00011 The present Invention relates to driving assist systems and methods for assisting efforts by operators to op- 
erate vehicles in traveling. 

2. Description of the Bacltground Art 

r00021 There is a need for a driving assist system, which can reliably assist effort by an operatorto operate a vehicle 
iuch Is an ai^omobne in traveling Currently available automobiles are equipped with a data acquis^on system and 
a cont^-'ner ^709 a processor. Such data acquisftion system can continuously acquire data -^^^f-S '"J^"^^^ 
on vSe state, such as current vehicle velocity, and information on environment In a tield around the vehicle. The 
;nfomiation on environment includes the presence of obstacles, including a leading vehcle ahead 
OOoT lSei a driving assist system should avoid objection by the operator of the automob.le m assisting the op- 
SS?or maSua effo^ to Xe a risk of collision with an obstacle. However, If the vehicle should encounter nsky enN^- 
roTr^ernvoMng the presence of an obstacle, the driving assist system should avoid collision with the ojstaclejhus 
t^J^? a netd for a system, which performs assist so that the operator can continue driving comfortably wrthout any 

27TTAt2^7BTpl^eL August 11 , discloses a steering control system, which modulates P0wer-e.3ist 
o? avoidanci of co isL upon recognition of a risk within a field around the vehicle. This steenng control system 
comZes t" magnftud;o 'risk with'respect to each of obstacles within the field around the vehicle. Vr,e magnrtude 
of hskt^ects t^e magnitude of impact upon collision with the obstacle. The magnitude of impact depends mainly upon 
thrrela^e veS between the vehicle and the obstacle. Accounting for this fact, the known system -^"te- a" 
JdivSual risk R(i) from an angular location a(i) expressed in tem,s of an azimuth angle of an obstacte « ^.^*ance or 
seTara«on^^^^^^^^ 

'he Tu'P vS the Obstacle i. This odd function involves a tern, of Vref(i)n = a real number grater than or 
equal to 3). The individual risk R(i) is expressed as, 

R(i)= ^<'^y^ W(«(l)) Eq.1 



where, 



f{Vref(i)) = Odd function that involves a temn of Vref(i)" (n > 3); 

d(i) = Distance (or separation) between the subject vehicle and the obstacle i; 

k = Constant to adjust the distance d(i); and 

W(a(i)) = Weighting component applied to the obstacle i appearing in the angular location a. 
[0005] The individual risks are summed vertorially to produce a resultant risk R. which is expressed as. 

R = ^R(i) ^ 

I 

The known steeringcontrolsystem is capable of avoiding collision with the obstacleby assisting the operatorto^ 

ooerator is proportional to the square of the relative velocity. ^ff«rt hw an 

rooosi It Is therefore an object of the present invention to provide a driving assist system for assisting effort by an 
Lperalor roperSe a vehicle in traveling, which can assist the operator without causing the operator to have any 
objectionable feel. 
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[00O7] It is another object of the present invention to provide a simple and economical driving assist system for 
assisting effort by an operator to operate a vehicle in traveling. 

SUMMARY OF THE INVENTION 

5 

[00O8] The present invention provides, in one aspect thereof, a driving assist system for assisting effort by an operator 
to operate a vehicle in traveling, the driving assist system comprising: 

a data acquisition system acquiring data including infonnation on vehicle state and information on environment in 

10 a field around the vehicle; 

a controller, mounted to the vehicle, for receiving the acquired data, for detennining future environment in the field 
using the acquired data, for making an operator response plan in response to the detemriined future environment, 
v/hich plan prompts the operatorto operating the vehicle in a desired manner for the determined future environment, 
to determine command, and for generating the command; and 

15 at least one actuator, mounted to the vehicle, for prompting the operator In response to the command to operating 

the vehicle in the desired manner 

[0009] The present invention provides, in second aspect thereof, a driving assist system for assisting effort by an 
operator to operate a vehicle In traveling, the driving assist system comprising: 

20 

a data acquisition system acquiring data involving Infonnation on the presence of a leading vehicle In a field around 
the vehicle; and 

a controller, mounted to the vehicle, for receiving the acquired data, for detemnining a first extent to which the 
vehicles has approached to each other and a second extent to which the first extent might be Influenced if a change 
25 in environment should occur, and for determining future environment in the field based on the first and second 

extents. 

[0010] The present invention provides, in third aspect thereof, a driving assist system for assisting effort by an op- 
erator to operate a vehicle In traveling, the driving assist system comprising: 

30 

a data acquisition system acquiring data Involving Information on the presence of an obstacle in afield around the 
vehicle; 

a controller, mounted to the vehicle, for receiving the acquired data, for detennining a risk which the obstacle would 
cause the operatorto perceive, for allocating commands for prompting the operatorto operating the vehicle Ion- 
35 gitudinally and laterally, and for generating the commands; and 

a plurality of actuators, mounted to the vehicle, to prompt the operator in response to the commands to operating 
the vehicle tongitudinalty and laterally. 

BRIEF DESCRIPTION OF THE DRAWINGS 

40 

[0011] The present invention will be apparent from reading of the following description in conjunction with the ac- 
companying drawings. 

Figure 1 is a control diagram showing control of a driving assist system. 
45 Figure 2 illustrate parameters relevant to a leading and following traffic scene. 

Figure 3 is a block diagram showing hardware of a first exemplary implementation of the present invention. 

Figure 4 is a view illustrating how the hardware of the first implementation is arranged on an automobile. 

Figure 5 is a block diagram showing hardware of a second exemplary implementation of the present invention. 

Figure 6 is a view illustrating how the hardware of the second implementation Is arranged on an automobile. 
50 Figure 7 is a flow diagram illustrating the operation of the first implementation. 

Figure 8 is a schematic view Illustrating one example of current environment in a field around the subject vehicle, 

which is detemnlned by the first Implementation. 

Figure 9 Is a schematic view Illustrating a future environment in the field around the subject vehicle, which is 

predicted by the first implementation, and the optimum path, 
55 Figure 10 is a timing diagram illustrating an example of a variation curve of the optimum steering angle for the 

vehicle to track the optimum path. 

Figure 11 Is a graphical representation of an example of steering reaction characteristic, which is provided at a 
moment of the curve of Figure 10, to prompt the vehble operatorto operating the steering wheel to the optimum 
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nrure?2Tsaflowdiagramillustratingtheoperationofas 

Figure 1 3 is a schematic view illustrating one example of current environment .n a fteld around the subject vehicle, 
which is determined by the second implementation. ... . u- i ...ki,.k 

Rgure 14 is a schematic view illustrating a future environment in the field around the subject vehicle, which .s 

predicted by the second Implementation. 

Figure 15 is a timing diagram illustrating an example of a variation curve of the optimum . . . 

Figures 1 6A and 1 6B are timing diagrams illustrating the optimum coordinated variations of accelerator and brake 

StTr f a gSjScal' representation of one example of accelerator pedal reaction characteristic, which Is pro- - 
vided al a moS of the cun,e of Figure 1 6A. to prompt the vehicle operator to operating the accelerator pedal 

'^^X::7^^^sorne.on of one example of brake peda, reaction charactenstlc. which is provided 
alamoment Of thecurve of Figure16B.toprompt the vehicle operatortooperatingtheb^^^^ 

Rgu'e'°9 IS a schematic view of a servo motor of an accelerator reaction characteristic modulation actuator Ir. 

operative relationship with an accelerator pedal. „„^^„t in«onfinn 

Figure 20 is a block diagram showing hardware of a third exemplary implementation of the present invention. 
Figure 21 is a view illustrating how the hardware of the third implementation Is arranged on an automobile. 
Figure 22 is a view illustrating an accelerator pedal reaction modulation mechanism 
Figure 23 is a graph Illustrating the relationship between accelerator pedal reaction force and stroke. 
Figure 24 is a flow diagram illustrating the operation of the third implementation. 

Figure 25 is a timing digram illustrating how. in a traffic scene in Figure 2. a veh^le operator predicts a change 

in velocity of a leading vehicle. 
Figure 26 is a RP map. 

n^g:: 28 m^am showmg hardware of a fourth exemplary implementation of the P-ent invention. 
Figure 29 a view illustrating how the hardware of the third Implementation is arranged on an automobile. 
Fiqure 30 is a flow diagram illustrating the operation of the fourth implementation. ^wiM.nnnfa 
Figure 31 is a graphical representation of a functfon detemiining a period of time that is used for prediction of a 
future environment in a field around the vehicle. 4„*:^„ 
FiguTe 32 is a flow diagram illustrating the operation of a first embodiment of a fifth exemplary implementation of 

Sgu'ISs il aSdTagram illustrating the operation of a second embodiment of the fifth exemplary implementation 

"Firure'JIl^ a ^apS illustrating the varying of risk perceived RP calculated as compared to rusk 

2uSy perceived by operatordurlngthefirst half andthe second half when the vehicle is approaching toaleading 

vehicle. 

Figure 35 is a graphical representation illustrating risks RPq and RPv 
Figure 36 is a map for parameters a, b. 

Fiaure 37 is a araphical representation illustrating risks KPq, RP^, and RP2. 

Figure 38 is a block diagram showing hardware of an eighth exemplary implementation of the present invention. 
Figure 39 is a view how the hardware of the eighth implementation is arranged on an automobile. 

Figure 40 is a flow diagram illustrating the operation of the eighth implementation 

Figure 41 is a graphical representation of the vanring of variance of separation for laser radar as compared to that 

Figure 4?isr^^aphlcal representation of the varying of variance of relative 

%guTJZ tea gfapWcrepresentation of the va^nng of variance of separation for the CCD camera with different 

Frgure°U?sf graphical representation of the varying of variance of relative velocity for the CCD camera wrth 
different kinds of obstacles. 

Figure 45 is an accelerator pedal reaction command (F;^) map. 
Figure 46 is a brake pedal reaction command (Fg) map. 
Fiaure 47 is a steering reaction command (Fs) map. 

Figure 48 is a flow diagram illustrating the operation of a ninth exemplary implementation of the present invention. 
Fiaure 49 is a map illustrating the relationship between RPk and operator inputs. »k«.w^hw^ 
Figure 50 is a map illustrating the relationship between RPLongitudha. and a" °P^'^^°' '"P"» 0P«"'"9 "^^""^ 
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longitudinally. 

Figure 51 is a map illustrating the relationship between RPLaterai an operator input for operating the vehicle 
laterally, 

Figure 52 is an accelerator pedal reaction command (F^) map. 
5 Figure 53 Is a brake pedal reaction command (Fg) map. 

Figure 54 is a steering reaction command (Fg) map. 

Figure 55 illustrates an accelerator pedal reaction characteristic according to the ninth implementation. 
Figure 56 illustrates a brake pedal reaction characteristic according to the ninth implementation. 
Figure 57 illustrates a steering reaction characteristic according to the ninth implementation. 
10 ' Figure 58 is a flow diagram illustrating the operation of a tenth exemplary implementation of the present invention. 
Figure 59 is a gain map according to the tenth implementation. 

DETAILED DESCRIPTION OF THE INVENTION 

15 [0012] Referring to Figure 1, a box 10 represents a vehicle operator, and a box 12 represents Input devices. Input 
devices 12 represent a steering wheel, an accelerator pedal and a brake pedal, which a motor vehicle 14 is usually 
equipped with 

[0013] Vehicle operator 10 perceives the vehicle state through nomnal senses, represented by feedback line 16, and 
environmcnl or s.lualion in a field around the vehicle through nonmal senses, represented by line 18. The operator 

20 applies manual cffon . f eprcsented by line 20, to the accelerator pedal, represented by input device 1 2 sending a power 
request command to an engine controller, not shown , of vehicle 1 4 through line 22. The operator applies manual effort, 
represented by tine 24. to the brake pedal, represented by Input device 12, sending a brake request command to a 
braking system, not shown, of vehicle 14 through line 26. The operator applies manual steering effort, represented by 
28, to the steering wheel, represented by input device 12 sending a steering request command to a steering system, 

25 not shown, of vehicle 14 through line 30. Input device 12 provides reaction force to the manual effort by the operator. 
[0014] The reference numeral 40 generally indicates a driving assist system for assisting effort by operator 10 to 
operate vehicle 1 4 in travelling. A data acquisition system (DAS) 42 arranged on or off the vehicle, continuously acquires 
data including information on the state of vehicle 1 4 and information on environment In a field around the vehicle. The 
information on the vehicle state includes velocity V^ of vehicle 1 4. The information on environment includes the presence 

30 of obstacles, such as, a leading vehicle in the same lane and other adjacent vehicles in the same or other lanes, in 
the field around vehicle 14. DAS 42 provides the presence of each obstacle in terms of angular location of the obstacle 
with respect to the subject vehicle 14 and relative velocity V^ between the obstacle and the subject vehicle 14. DAS 
42 may provide velocity of each of the obstacles. The infonmation on environment also includes the presence of lane 
markings In the field around vehicle 14. DAS 42 may provide the presence of lane markings in terms of lateral dis- 

35 placement of the subject vehicle 14. DAS 42 may provide weather condition in the way of the subject vehicle 14. 

[0015] Driving assist system 40 receives and uses the acquired data, represented by line 44. A predicting module 
46 uses the acquired data 44 to detemriine or predict future environment in the field around vehicle 14. Using the 
determined future environment as input 48, a plan making or building module 50 makes or builds an operator-response 
plan, which prompts vehicle operator 10 to operating vehicle 14 in a desired manner for the predicted future environ- 

40 ment. To implement the operator-response plan, command or commands are determined. The detennined command 
or commands are generated and provided to actuator(s) 52 through line 54. In response to the command(s), actuator 
(s) 52 prompts the vehicle operator 10 to operating the vehicle 14 in the desired manner. 

[0016] In embodiments, the actuator(s) 52 acts on input device 1 2 through line 56 to modulate reaction characteristic 
to manual effort applied to the Input device by the vehicle operator 10. In one embodiment, the future environment 

45 determined by predicting module 46 involves a risk which each of the detennined obstacles would cause the vehicle 
operator 1 0 to perceive. Such risks are summed vertorially to produce a resultant risk. In this case, the planning module 
50 makes an operator-response plan that prompts operator 1 0 to operating vehicle in a desired manner to reduce the 
resultant risk. In another embodiment, the future environment further involves a risk derived from the road condition. 
Such risk is determined by a lateral deviation of vehicle 14 from a lane and by curvature of the lane. In this embodiment, 

50 the planning module 50 makes an operator response plan that prompts operator 1 0 to operating vehicle in a desired 
manner to reduce the resultant risk superimposed by the risk derived from the road condition. In the embodiments, the 
operator-response plan made by planning module 50 includes the amount input to the actuator(s) 52. 
[0017] Building of the operator response plan must account for type of actuator(s) 52 employed. In one embodiment 
where the actuator{s) 52 is capable of modulating reaction characteristic to manual steering effort by operator 10, plan 

55 making module 50 can make an operator- response plan, which prompts vehicle operator 10 to operating vehicle 14 
laterally in such a manner as to reduce the resultant risk. In another embodiment where the actuator(s) 52 is capable 
of modulating reaction characteristic to manual effort applied to the accelerator pedal along with modulating reaction 
characteristic to manual steering effort, plan making module 50 can make an operator-response plan, which prompts 
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vehicle operator 1 0 to operating vehicle 1 4 longitudinally and laterally in such a manner as to reduce the ^e^^'tant nsk. 
[001 81 While the plan-making module 50 and predicting module 4646 can be implemented in hardware or software, 
t is most likely implemented in software. In a software implementation, the modules 46 f /^P-"^^"^ ^^i;';;^^ 
instructions stored in a memory of a computer, and executed in the processor, and the acquired data stored 'n memoj. 
5 In hardware implementations, the modules 46 and 50 are implemented in digital logic preferably m ^"^tSft I 
r001 91 Before describing implementations in detail, it is helpful to begin wrth consideration of paramete s tha define 
relationship between the two adjacent vehicles on the same lane. Figure 2 illustrates the P«;«'"«^f ^--^If^^^^^^^j!;^ " 
adjacent vehicles in travel on the same lane at different velocities. In the parameters, time to contact TTC and time 

headway THW are described later 
10 [00201 The following description provides various implementations of the present invention. 

First Implementation of the Invention 

r0021l Figure 3 provides hardware, and Figure 4 illustrates how the hardware is arranged on an automobile 70^ 
r0022 In Figure 3. the reference numeral 40A generally indicates a driving assist system Driving assist system 40A 
ncludes an on board data acquisition system (DAS) 72. DAS 72. mounted to the vehicle 70. includes 'aser radar 7^ 
a front camera 76, a rear right side (RRS) camera 78R. a rear left side (RLS) camera 78L. and a source of vehicle 

[S^^Referring to Figure 4. vehicle 70 has laser radar 74 mounted to a front bumper thereof Laser radar 74 may 
be mounted to a front grille of the vehicle. Laser radar 74 is of a type which can scan horizontally and ^terally about 
6 degrees to each side of an axis parallel to the vehicle longitudinal centerline. propagates infrared pulses forwardly 
and receives the reflected radiation by an obstacle, such as, a rear bumper of a leading vehicle. J^ ^e 

provide an angular location of the leading vehicle and a vehicle separation or a distance between the subject vehicle 

[0024? *^Fronfcamera 76 is of a CCD type or a CMOS type and mounted to vehicle 70 in the vicinity of the internal 
rear view mirror to acquire image data of a region in front of the vehicle. The region covered by front camera 76 extends 
from a camera axis laterally to each side by about 30 degrees. 

[00251 RRS and RLS cameras 78R and 78L are. each, of a CCD type or a CMOS type RRS camera 78R is mounted 
o vehicle 70 in the vicinity of the intemal rear right comer to acquire image data of rear scenery including the adjacent 
lane on the right-hand side. RLS camera 78R is mounted to vehicle 70 in the vicinity of the intemal rear left comer to 
acquire Image data of rear scenery including the adjacent lane on the left-hand side. ^ ^ ^^^^ 

[0026] Source of vehicle speed 80 may obtain a measure of vehicle velocity by processing outputs from wheel speed 
sensors. The soi-rce of vehicle speed 80 may include an engine controller or a transmission controller, which can 
provide a signal indicative of the vehicle velocity. »u„o^„,,ir^rt 
ra027] Driving assist system 40A includes a microprocessor-based controller 82. Controller 82 receives the acqu red 
data from DAS 72. From source of vehicle speed 80. controller 82 receives information on the vehicle velocity V,. From 
laser radar 74 controller 82 receives information on vehicle separation D between the subject vehicle 70 and the 
adjacent leading vehicle. From the image data provided by front camera 76, controller 82 receives 'njo^^^atoon on 
vehicle separation D between the subject vehicle 70 and each of vehicles in front. From the image date pmvided by 
RRS and RLS cameras 78R and 78L. controller 82 receives infomnatlon on the presence of vehicles, in the adjacent 
lanes, approaching from the rear, and it also receives infomiation on extent to which each vehicle is f PP^o«^^';^^;:°'" 
the image data provided by front camera 76, controller 82 receives infomiation on the presence of lane mari(ings on 
a road information on the lateral position of the vehicle relative to the lane mari<ings, and information on the angular 
position Of the vehicle relative to the lane markings. Using such information , controller 82 d^te^mes curren^ enviroiv 
ment or situation In a field around vehtele 70. Using the current and past values of environment, controller 82 predicts 
or determines future environment in the field around vehicle 70 for building of an operator response plan 
[00281 According to this implementation, the operator response plan includes using the cun-enl and future environ- 
ments to detemnine the optimum path for vehicle 70 to take, establishing the optimum steenng angle for veh.c e 70 to 
track the detemiined optimum path, and detemnining the optimum steering reaction characteristic for Prompting he 
vehicle operator to operating the steering wheel to the optimum steering angle. Controller 82 determines the amount 
of command in response to the detemiined optimum steering reaction characteristic. Controller 82 generates the com- 
mand and applied it to a steering reaction modulation actuator 84. . u . • 
[00291 Steering reaction modulation actuator 84 includes a controller called a steering reaction characteristic mod- 
ulator 86 and a servo motor 88. Servo motor 88 is incorporated in the steering mechanism to modulate steenng reaction 
characteristic to operator steering effort. Modulator 86 controls output torque of sen/o motor 88 in response to the 
command from controller 82 such that the steering reaction characteristic is adjusted to the reaction characteristic 

[oS'"?hfflow d°agr^m in Figure 7 illustrates a control routine of the first implementation of the present invention. 
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The control routine, generally indicated at 100, is executed at regular time intervals of 50 milliseconds. 
[0031] At input box 1 02, the processor of controller 82 inputs acquired data by DAS 72. Specifically, the processor 
inputs vehicle velocity Vf, an angular location of a leading vehicle and a vehicle separation D between the subject 
vehicle 70 and the leading vehicle, and relative relation between the subject vehicle 70 and each of vehicles that are 

5 determined by RRS and RLS canneras 78R and 78L. 

[0032] At box 1 04, using the Input data at box 1 02, the processor detemnines current environment in a field around 
vehicle 70. Particularly, the processor builds a current hazard map visualizing the possibility of collision of the subject 
vehicle 70 with each of other vehicles from current and past values of the acquired data at box 102. 
[0033] The possibility of collision with another vehicle lowers as the vehicle 70 separates from it. This possibility may 

10 ■ be expressed as a function of the reciprocal of vehicle separation or the reciprocal of the square of vehicle separation. 
If the relative velocity between the two vehicles can be neglected, isograms in the hazard map are concentric circles 
with the location of the vehicle as the center. However, if the relative velocity between the two vehicles is not negligible, 
the isograms protrude in the direction of a vector of the relative velocity. 

[0034] Accounting for the vehicle lateral position from the lane marking and the road curvature has proven to be 
15 effective for enhanced building of a hazard map. The possibility of collision grows big as the vehicle gets close to the 
lane marking separating the adjacent lanes or to the edge of a road. Weighting component is the least when the vehicle 
follows the centerline of a lane, and it gets great as the vehicle is close the lane marking or to the edge of road. With 
different weighting components, this collision possibility due to the lane marking and the before-mentioned collision 
possibility due to other vehicles are summed to provide enhanced hazard map. The weighting component applied to 
20 the collision possibility due to other vehicles is less than the weighting component applied to the collision possibility 
due to the lane markings. 

[0035] Figure 8 illustrates an example of a current environment expressed in terms of a hazard map at the moment 
(t = 0). The environment involves a vehicle traveling scenario on a road with three lanes. In the middle lane, the subject 
vehicle 70 is following a leading vehicle 1 20. Vehicle 70 is traveling at a vehicle velocity V^, while vehicle 1 20 is traveling 
25 at a vehicle velocity V^. As V, > Vg, a vector originating at vehicle 120 indicates the relative velocity between the two 
vehicles 70 and 120. In the left adjacent lane, a vehicle 122 is traveling at a vehicle velocity lower than Vf. A vector 
originating at vehicle 1 22 indicates the relative velocity between the two vehicles 70 and 122. In the right adjacent lane, 
a vehicle 124 is traveling at a vehicle velocity higher than Vj. 

[0036] At the moment (t = 0), vehicle 122 closes a path 126 for vehicle 70 to take to the left adjacent lane. Thus, 
30 path 1 26 is not justified. Apparently, vehicle 124 is about to dose space in the right adjacent lane, closing any path for 
vehicle 70 to take to the right adjacent lane. The vehicle separation between the two vehicles 70 and 1 20 allows vehicle 
70 to stay in the middle lane. In this environment, what the vehicle operator has to do is to continue driving vehicle 70 
in the middle lane. 

[0037] At box 106, after it has determined the current environment, the processor predicts or determines future 
35 environments related to different future moments. The different future moments have different time values, respectively 
The time values are arranged regularly with the largest time value being a predetennined time value of 5 seconds in 
this implementation. 

[0038] Figure 9 illustrates an example of one future environment expressed in terms of a hazard map at a future 
moment (t =T). 

40 [0039] At this future moment (t = T), vehicle 1 22 opens a path 1 26 for vehicle 70 to take to the left adjacent although 
the vehicle separation between vehicles 70 and 1 20 has reduced and vehicle 1 24 has closed space in the right adjacent 
lane. In this future environment, the path 1 26 is justified and may be set as the optimum path at the future moment (t = T). 
[0040] At box 108, the processor uses the predicted future environments to determine the optimum path at each of 
the moments. The following provides a description on what has been taken into account in detemnining the optimum 

45 path at each moment. The optimum path has been detemnined by finding, in a hazard map for each moment, a provi- 
sional location, within an area around the location of vehicle 70, where the collision possibility is the local minimum. 
The processor checks on one after another of the provisional location and the adjacent other locations whether or not 
lateral acceleration and yaw angular rate due to a change from the current location to the one of the locations falls 
within an acceptable range. If the provisional location has past the test, it is used as the optimum location. If not, any 

50 one of the adjacent other locations that has past the text is used as the optimum location. 

[0041] At box 110, the processor determines the optimum steering angle 6* to accomplish the optimum path, and 
the optimum steering reaction characteristic to prompt the vehicle operator to operating the steering wheel to the 
optimum steering angle 6*. The optimum steering angle 5* may be determined by the steering characteristic and the 
optimum path. Figure 1 0 provides an example of a variation curve of the optimum steering angle 5*. Figure 11 provides 

55 one example of steering reaction characteristic, which is provided at a moment of the variation curve of Figure 10, to 
prompt the vehicle operator to operating the steering wheel at the optimum steering angle 5* at the moment. The 
steering reaction characteristic of Figure 11 provides almost zero reaction force (F, = 0) at the optimum steering angle 
5*. As the steering angle 5 moves to the right out of this optimum steering angle 6*. the steering reaction force Fg 
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increases at slope angle of Ksr. As the steering angle 5 moves to the left out of this optimum steering angle 8*, the 
steering reaction force Fq increases at slope angle of Kql- 

[0042] The slope angles Ksr and Ksl are not fixed and determined by gradient of the collision possibility on one side 
in the vicinity of the optimum path and gradient on the opposite side in the vicinity thereof. Such gradients can be given 

5 from isograms on both sides of the optimum path within the predicted hazard maps (see box 1 06 in Figure 7). Operator 
steering effort to increase deviation from the optimum path to left or right is opposed by a reaction force determined 
by slope angle Ksl or Ksr. If a rapid change in the collision possibility exits on the right side of the optimum path, the 
slope angle KgR increases to provide increased reaction force. If a rapid change in the collision possibility exits on the 
left side of the optimum path, the slope angle Ksl increases to provide increased reaction force. This steering reaction 

10 characteristic prompts the vehicle operator to operating the steering wheel to track the optimum path. 

[0043] At output box 112, the processor outputs command indicative of the determined reaction charactenstic to 
steering reaction modulation actuator 84 (see Figure 3). The command is applied to the modulator 86 of the actuator 
84. Under the control of the modulator 86, sen/o motor 88 operates to provide the determined steering reaction char- 
acteristic to the manual steering effort applied to the steering wheel by the vehicle operator. 



15 



Second Implementation of the Invention 



[0044] Figure 5 provides hardware, and Figure 6 illustrates how the hardware is arranged on an automobile 70B. 
[0045] In Figure 5. the reference numeral 40A generally indicates a driving assist system. Driving assist system 40B 
20 includes an on board dnlri acquisition system (DAS) 72B. DAS 72B, mounted to the vehicle 70B, includes laser radar 
74. a front camera 76. and a source of vehicle speed 80. DAS 72B is substantially the same as DAS 72 except the 
elimination of RRS and RLS cameras 78R and 78L. 

[0046] Referring to Figure 6, vehicle 708 has laser radar 74 mounted to a front bumper thereof . Front camera 76 of 
a CCD type or a CMOS type is mounted to vehicle 70B in the vicinity of the internal rear view mirror to acquire image 
25 data of a region in front of the vehicle . Source of vehicle speed 80 may obtain a measure of vehicle velocity by processing 
outputs from wheel speed sensors. The source of vehicle speed 80 may include an engine controller or a transmission 
controller, which can provide a signal indicative of the vehicle velocity. 

[0047] in Figure 5. driving assist system 40B includes a microprocessor based controller 82B. Controller 82B receives 
the acquired data from DAS 72B. From source of vehicle speed 80, controller 82B receives infomriation on the vehicle 

30 velocity V,. From laser radar 74, controller 82B receives information on vehicle separation D between the subject vehicle 
70B and the adjacent leading vehicle. From the image data provided by front camera 76. controller 82B receives 
infonnation on vehicle separation D between the subject vehicle 70B and each of vehicles in front. From the image 
data provided by front camera 76, controller 82B receives information on the presence of lane markings on a road, 
information on the lateral position of the vehicle relative to the lane markings, and information on the angular position 

35 of the vehicle relative to the lane markings. Using such infonnation, controller 828 detemiines current environment or 
situation in a field around vehicle 70B. Using the cun^ent and past values of environment, controller 82B predicts or 
detemiines future environments in the field around vehicle 70B for building of an operator response plan. 
[0048] According to this implementation, the operator response plan includes using the current and future environ- 
ments to determine the optimum vehicle velocity for vehicle 70B to take, establishing the optimum pedal positions of 

40 an accelerator pedal and a brake pedal for vehicle 70B to travel at the detennined optimum vehicle velocity, and 
determining the optimum accelerator and brake reaction characteristics for prompting the vehicle operator to operating 
the accelerator pedal and brake pedal to the optimum pedal positions. Controller 82B detemnines the amount of ac- 
celerator pedal reaction command in response to the determined optimum accelerator reaction characteristic. Control- 
ler 82B also determines the amount of brake pedal reaction command in response to the determined optimum brake 

45 reaction characteristic. Controller 82B generates the accelerator reaction command and applies it to an accelerator 
reaction modulation actuator 140. Controller 82B generates the brake reaction command and applies it to a brake 
reaction modulation actuator 142. 

[0049] Accelerator reaction modulation actuator 140 includes a controller called an accelerator pedal reaction char- 
acteristic modulator 144 and a servo motor 146. Brake reaction modulation actuator 142 includes a controller called a 

50 brake pedal reaction characteristic modulator 148 and a brake booster 150. 

[0050] Referring also to Figure 19, servo motor 146 is incorporated into a link mechanism of an accelerator pedal 
152 to modulate accelerator reaction characteristic to operator effort to depress accelerator pedal 152. Modulator 144 
controls output torque of servo motor 146 in response to the command from controller 82B such that the accelerator 
reaction characteristic is adjusted to the reaction characteristic determined at controller 82B. 

55 [0051] Referring back to Figures 5 and 8. brake booster 150 can vary a brake assist to modulate brake reaction 
characteristic to operator effort to depress a brake pedal 154. Modulator 148 controls brake booster 150 in response 
to the command from controller 82B such that the brake reaction characteristic is adjusted to the reaction characteristic 
determined at controller 82B. 
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[0052] The flow diagram in Figure 12 illustrates a control routine of the second Innplennentation of the present inven- 
tion. The control routine, generally indicated at 160, is executed at regular time Intervals of 50 milliseconds. 
[0053] At Input box 162, the processor of controller 82B inputs acquired data by DAS 72B. Using the image data 
from front camera 76, the processor determines the position of lane markings and the position of each of vehicles in 
5 front relative to the lane markings. Based on the relative position of each of the vehicles in front to the lane markings, 
the processor picks up a leading vehicle on the same lane as a target to be monitored by laser radar 74 for the sub- 
sequent control. The processor inputs an angular location of the leading vehicle, and a vehicle separation D between 
the subject vehicle 70B and the leading vehicle from laser radar 74. The processor receives vehicle velocity from 
source of vehicle speed 80. 

10 * [0054] At box 1 64, using the acquired data received at box 1 62, the processor determines current environment in a 
field around vehicle 708. Particularly, the processor builds a current hazard map visualizing the possibility of collision 
of the subject vehicle 70B with the following vehicle from current and past values of the acquired data. 
[0055] The possibility of collision with the leading vehicle lowers as the vehicle 70B separates from it. This possibility 
may be expressed as a function of the reciprocal of vehicle separation or the reciprocal of the square of vehicle sep- 

15 aration. If the relative velocity between the two vehicles can be neglected, isograms In the hazard map are concentric 
circles with the location of the vehicle as the center. However, if the relative velocity between the two vehicles is not 
negligible, the isograms protrude In the direction of a vector of the relative velocity. 

[0056] Figure 13 illustrates an example of a current environment expressed in tenns of a hazard map at the moment 
(I = 0). The environment involves a vehicle traveling scenario within a lane on road. A leading vehicle 120 exists in the 
20 same lane. Vehicle 70B is traveling at a vehicle velocity Vf, while vehicle 120 is traveling at a vehicle velocity Vg. As 
> Vg, a vector originating at vehicle 120 indicates the relative velocity between the two vehicles 70B and 120. At the 
moment (t = 0), there is a sufficient vehicle separation. 

[0057] At box 186, after it has determined the current environment, the processor predicts or determines future 
environments related to different future moments. The different future moments have different time values, respectively. 
25 The time values are arranged regularly with the largest time value being a predetermined time value of 5 seconds in 
this implementation. 

[0058] Figure 14 illustrates an example of one future environment expressed in terms of a hazard map at a future 
moment (t =T). At this future moment (t = T), the vehicle separation is not sufficient. 

[0059] At box 168, the processor uses the predicted future environments to determine the optimum path at each of 
30 the moments. The following provides a description on what has been taken into account in detemrilning the optimum 
path at each moment. The optimum path has been determined by finding, in a hazard map for each moment, a provi- 
sional location, within an area around the location of vehicle 708, where the collision possibility is the local minimum. 
The processor.checks on one after another of the provisional location and the adjacent other locations whether or not 
longitudinal acceleration due to a change from the current location to the one of the locations falls within an acceptable 
35 range. If the provisional location has past the test, it is used as the optimum location. If not, any one of the adjacent 
other locations that has past the text is used as the optimum location. In the second implementation, the lateral control 
is out of consideration. Hence, the optimum path is found in the same lane so that it may be taken by taken by vehicle 
70B by varying the vehicle velocity. 

[0060] At box 170, the processor determines the optimum vehicle velocity V* to accomplish the optimum path, the 

40 optimum accelerator and brake pedal positions 0^* and 0^*, and accelerator and brake pedal reaction characteristics. 
Figure 15 provides an example of a variation curve of the optimum vehicle velocity V*. Figures 16A and 16B provide 
one example of a coordinated variations of optimum accelerator and brake pedal positions G^* and Gg* to accomplish 
the optimum velocity variation shown in Figure 15. In Figures 1 6A and 16B, during period of time T^ andTg, the optimum 
accelerator pedal position 6^* slightly reduces to gradually slow vehicle 708 down. During the subsequent period of 

45 time T2 and T3, the optimum accelerator pedal position 6^* has reduced to zero and the optimum brake pedal position 
Bg* increases temporally to effectively decelerate vehicle 70B. Finally, during period of time T3 and T4, the optimum 
accelerator pedal position 6^^* accelerate vehicle 70B until it can beautifully follow the leading vehicle. 
[0061] According to the second implementation, modulating accelerator and brake pedal reaction characteristic has 
accomplished the desired coordinated variations of the optimum accelerator and brake pedal positions 6^* and Q^* 

so [0062] Figure 17 provides one example of accelerator pedal reaction characteristic, which Is provided at a moment 
of the variation curve of Figure 1 6A, to prompt the vehicle operator to operating the accelerator pedal at the optimum 
accelerator pedal position 9^* at the moment. The accelerator reaction characteristic of Figure 1 7 is recessed from the 
usual reaction characteristic, as indicated by slope angle K^q. at the optimum accelerator pedal position 8^*. As ac- 
celerator pedal position G^^ moves to the right out of this optimum accelerator pedal position G^^*, the accelerator pedal 

55 reaction force F^ increases at slope angle of K^f- As accelerator pedal position 9^ moves to the left out of this optimum 
accelerator pedal position G^*, the accelerator pedal reaction force F^ increases at slope angle of K^b- 
[0063] The slope angles and K^^q are not fixed and determined by gradient of the collision possibility if deviated 
longitudinally from the optimum position. Such gradients can be given from isograms around the optimum position 
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angle of Kbb- . .nH ar^^notfiyedanddeterminedby gradient of the collision possto^^^^^ 
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Srrrrir4rp=xrror;^^^^^^ 

manual effort applied to the brake pedal by the vehicle operator. 
30 Third Implennentation of the Invention 
[First Embodiment! 

70C in the same manner as the second implementation (see Figures 5 and 6) ... ..^ controller 82C re- 

1006.3 ,n 2^^^-^^^^^^^^ DAS 

rZVl ::rfof v^^i Tpe^^^ 'n,om,ation on the vehiCe ve.oci^ V From -as-^^^^^ 

yfcoZller sS receives in^omiation on vehiCe separation D be^«een the subject veh^le 70C and the adjacent 

Th/«..tr,ut Of Stroke sensor 1 78 Is fed to modulator 144. In response to command from modulator 144. 

L^o zJ^Jt^^^^o::^^^.^^^^ -'^'o" ^"''^ ''^'^ """^^"'^ 

55 mo?27'contSler 82C receives infom,ation on vehicle separation D between vehicle 70C and a '^-^ing vehlc^^^ 
SatifnTn^erative velocity V, between the vehicles, and infomiation on vehicle velocity V, of vehicle 70C from he 
.nfomiaton on relative vOT 

rj:4ntn^^^^^^^^ vehicle 70C has approached the leading veh^le. and a second extent (= a 
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second risk category) to which vehicle 70C might be influenced due to a predictable change in movement of the leading 
vehicle. Controller 82C uses the first and second extents to predict future environment expressed in terms of risk 
perceived (RP), determines an accelerator pedal reaction command AF based on the RP. Command AF is applied to 
modulator 144. Modulator 144 controls servo motor 146 in response to command AF, thus modulating reaction force 

5 versus stroke characteristic of accelerator pedal 152. 

[0073] In Figure 23, a set of two parallel line segments interconnected by another set of two parallel line segments 
to enclose an area dotted illustrate usual reaction force characteristic. Under this condition, no additional force is applied 
to modulate the reaction force characteristic. With the accelerator pedal reaction modulation, this usual reaction force 
characteristic is elevated by AF over the whole range of stroke. As AF is proportional to RP, the vehicle operator can 

10 ' perceive through accelerator pedal 1 62 the current environment and predicted future environment in the field around 
vehicle 70C. 

[0074] The flow diagram in Figure 24 illustrates a control routine of the third implementation. The control routine, 
generally indicated at 180, is executed at regular time intervals of 50 milliseconds. 

[0075] At input box 1 82, the processor of controller 82C inputs acquired data by DAS 72C. What are read at box 1 82 
15 include velocity Vf of vehicle 70C, vehicle separation D between vehicle 70C and a leading vehicle, relative velocity 
Vr between the vehicles, and velocity of the leading vehicle. 

[0076] At box 184, the processor calculates time to contact (TTC) and time headway (THW). 
[0077] We introduced the notion of TTC to quantify a first extent to which the subject vehicle 70C has approached 
to a leading vehicle In the traffic scene illustrated in Figure 2. This first extent is introduced to represent how much the 
20 vehicle 700 has approached to the leading vehicle. 
[0078] TTC is expressed as, 

TTC = DA/, Eq. 3 

25 

where, 

D = Vehicle separation between the vehicles in the traffic scene illustrated in Figure 2 
Vr = Relative vehicle velocity Vf - 

30 

In the traffic scene of Figure 2, most operators perceived risk and operated the following vehicles for deceleration well 
before TTC becoming less than 4 seconds. We considered that, risk, which each vehicle operator perceived, prompted 
the operator to operate the vehicle longitudinally to resume sufficient vehicle separation. The shorter TTC. the greater 
the magnitude of risk, which the leading vehicle causes the vehicle operator of the following vehicle to perceive, is. 
35 However, there is some discrepancy between TTC and risk perceived by the vehicle operator. Thus, TTC only is in- 
sufficient to quantify or express the risk perceived by operator. 

[0079] The presence of such discrepancy may be confirmed by considering a traffic scene where the relative velocity 
Vr between the leading and following vehicles is zero. In this case, TTC is infinite irrespective of how short the vehicle 
separation D is. Apparently the risk perceived by the operator of the following vehicle varies with different distances 
40 of vehicle separation D. The shorter the vehicle separation D, the bigger the risk perceived by the operator is. This is 
because the vehicle operator accounts for the magnitude of influence on TTC due to unpredictable drop in velocity Vg 
of the leading vehicle. 

[0080] With reference to Figure 25, this section provides a further description on the above issue. Immediately before 
the moment t = 0, the relative velocity between the leading and following vehicles is positive and fixed, and TTC 

4^ has been updated by calculating the equation 3. In operating the following vehicle, the operator keeps on predicting 
the magnitude of an unpredictable change, particularly, a drop, in velocity of the leading vehicle, which might occur 
at the moment At after. Accurate prediction of at the moment At after is impossible, however. Thus, the operator 
tries to predict the velocity Vg with considerable dispersion as illustrated In Figure 25. In Figure 25, if, at the moment 
At, the velocity drops to from V^, TTC becomes shorter than expected At before, resulting in an increase in risk 

50 than expected. Predication of such increase in TTC from the current and past values of TTC is difficult. 

[0081] To overcome this difficulty, according to the third implementation, we introduced the notion of time headway 
(THW). THW is a physical quantity quantifying a second extent to which TTC might be influenced if a change in velocity 
Va of a leading vehicle should occur. The second extent is introduced to represent how much a change in relative 
velocity Vp if any in immediate future, might influence TTC. THW is expressed as, 

55 

THW=D/Va Eq.4 
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or 

THW = D/V, ^ 

rO0821 THW is a measure of a timer that is set to count when the leading vehicle reaches a point on a road and will 
Le SetsubVequently when the following vehicle will reach the same point. The '""Se--™ the smaller me se^^^^^^^^ ■ 
e^Sts That is. when THW is long, the first extent is not greatly influenced due to a change .n V,. -f any. of the leading 
vehicle so that a change in TTC is sufficiently small. 

10 roossr Ssing THW is to quantify the influence caused due to a future change in V3. In his respect, the use of THW 
deteniined by V3 is recommendable rather than the other THW detem,lned by V,. Besides the ^^he 
risk tZ is perc Jved by the operator with better accuracy than the latter does. However, if a value of that is given 
S a meaL'roWrand a measure of V. is less reliable than a value of V,. the use of THW determined by V, is recom- 
mendable. In the traffic scene where V, = V,. the equations 4 and 5 are equally . ^ ^ 

« r00841 With continuing reference to the flow diagram in Figure 24. after calculating TTC and THW at box 1 84, the 
oqic qoestrbox 186. At box 186, the processor uses TTC andTHWto create a physical quantity that is md-cative 0 
rXSed (RP) by the vehicle operator. We introduced the notion of RP. which we call "Risk Perceived", o represent 
the SnSe of isk which a veMcle operator would perceive upon predicting future environmen in a field around 
J e S in the traffic scene illustrated in Figure 2. the environment in the field around vehicle involves the presence 

- c5 alea^g-Jlcle. In creating the RP. we Introducedthe reciprocal of TTC (1/TTC) as the first -JJ^^^^^^^^^^ 
of THW (l/THW) as the second extent. According to the third Implementatton. they are summed to produce the RP. 
which is expressed as, 



2S 



RP = a(i n-HW) + b(i nrc) ■ 



where b and a (b > a) are parameters weighting the first extent (l/TTC) and the second extent (inHW), respective^ 
rchthattSsecondextent(1/THW)islessweightedthanthef^^^^ 

act Jn«n"fo^^^^^^^ of values of THW and TTC collected In the traffic scene including leading and trailing 

" JooTsr ^e:Z:7^^^:^ ^r:. . c... TTC is a first Hsk category or component indicating how 
ong ft takes for a following vehicle to contact with a leading vehicle if it is assumed that the relative ^^^^'^^^^^^ 
Je vehteles is constant The equations 4 and 5 reveal that time headway THW is a second nsk category or component 
ndicS how to^^^^^^^ for the following vehicle to arrive at the point, which the leading vehicle has arrived at rorn 

35 heTnl ance of a^tal of the leading vehicle if It is assumed that the relative velocity V, will be sub,ect to a drop. Using 
the flit and second risk categories TTC and THW, defined by current values of D. V, V3 and V„ in the equation 6 
yirrskpec^^^^^^^ 

Tnothlng but predicting a future environment in a field around the vehicle using current values of D, V,. Va and V 
0M61 The RP can provide quantitative expression as to how much a following vehicle has approached to a 'ead.ng 
40 Se continuously over a range from its separating from the leading vehicle to its approaching to same. The more 
"ncrlaSMhem^ 



The RP map in Figure 26 illustrates, within a THW- (1/TTC) plane, isograms of RP drawn based on the 
Son^^e ho^zor^tal axis represents THW The horizontal axis is a horizontal line originating at a value of 0.0 on 
« Tvert cal aT^ and extending in the rightward direction. The vehicle Is assumed to ''V^^triZJfl'^o'^^^^^^^^^^ 

an unaltered relative velocity V,. In Figure 26, the vehicle is operating at some operating point on the ^onzon al axis^ 
The Sher the operating poin/on the horizontal axis is distant from the vertical axis in the rightward djec ion^he 
Lrther tJe vehli is separated from the leading vehicle. The vertteal axis represents the reciproca of TTC inTC). 
Now when the vehicle is assumed to start approaching to the leading vehicle due to a drop in relative veU>c V = 
50 V, V ) In Figure 26. the operating point at which the vehicle is operating moves from he operating point on the 
horizontal axis as directed by an approaching motion vector. This motion vector is a resultant vector of a honzontal 
i^S^^ ^IpTnent t in the le^ard direction and a vertical vector component in the upwa^ direction Next^ 
wl^n t^e vehicle is assumed to start separating from the leading vehicle due to an increase in relatve velocity V . In 
Figure 26 the operating point at which the vehicle is operating moves from the operating point on the honzontal ax« 
55 a?d"ected by a'separatlng motion vector. This motion vector Is a resultant vector of a horizontal vector component 

oriented in the rightward direction and a vertical vector component in the downward direction. ^ 

raOM] The operating point approaching to the leading vehtele moves through an upper section of the isograms of 
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RP in a direction increasing RP, while the separating point separating the leading vehicle nnoves through a lower or 
the remaining section of the isograms RP in a direction reducing RP. The upper and lower sections are interconnected 
at the horizontal axis. In the upper section, lines of the isogranns extend fronn vertically spaced generally equidistant 
start points on the right edge of the RP map to differently spaced intennediate points on the horizontal axis, respectively. 

5 The intermediate points are arranged such that a distant between the adjacent two points of them becomes narrower 
and narrower as the THW becomes shorter and shorter. The lines of the isograms curve downwardly from the start 
points to the intemiedlate points to define a range of the highest or higher values of the RP. Such range is reached at 
a value of the reciprocal of TTC {1/TTC), which becomes smaller as the value of THW becomes smaller. Further, with 
the same value of THW. the higher the reciprocal of TTC (1/TTC), the higher the RP is. Besides, with the same value 

10 ' of the reciprocal of TTC (1/TTC), the shorter the THW, the higher the RP Is. In the lower section, lines of the isograms 
extend from vertically spaced generally equidistant start points on a vertical line, not illustrated, near the left edge of 
the RP map to the differently spaced intermediate points on the horizontal axis and a point on the right edge of the 
map, respectively. The lines of the Isograms curve upwardly from the start points to the intemiediate points to define 
a range of the lowest or zero value of the RP. 

15 [0089] With continuing reference to the flow diagram of Figure 24, after calculation of the RP at box 186, the logic 
goes to box 188. 

[0090] At box 188, the processor uses the RP to detemnine an accelerator pedal reaction command AF. which is 
expressed as, 

20 

AF=K*RP Eq. 7 

where, 

K = Constant determined for adjustment. 

25 [0091] As readily seen from the RPmap in Figure 26, the RP takes various values continuously over different values 
of THW and 1/TTC of environment in a space around the vehicle. The RP detemnines the command AF as expressed 
by the equation 7, which, in turn, determines accelerator pedal reaction force. This makes it possible for the operator 
to continuously know information how much the vehicle has approached to the leading vehicle. 
[0092] At the next box 1 90, the processor outputs the command AF and applies it to the accelerator pedal reaction 

30 characteristic modulator 144 (see Figure 20). 

[0093] The preceding description on the equation 6 and the RP map in Figure 26 clearly reveals that the RP takes 
various values continuously even if the first extent (1/TTC) and/or the second extent (1/THW) are subject to a change. 
Such smooth and continuous change in the RP makes it possible to vary accelerator pedal reaction force accordingly. 
Hence, the operator can recognize varying of environment through smooth and continuous change in accelerator pedal 

35 reaction force. 

[Second Embodiment] 

[0094] The second embodiment of the third implementation is substantially the same as the first embodiment thereof 
40 except the manner of producing the RP. In the first embodiment, the RP was expressed as the equation 6. In this 
second embodiment, RP is expressed as, 

RP = max {a/THW, b/TTC) Eq. 8 

45 

where, b and a (b > a) are parameters weighting the first extent (1/TTC) and the second extent (1/THW), respectively, 
such that the second extent (1/THW) is less weighted than thef irst extent (1/TTC) is. The values of b and a are optimized 
after accounting for a statistics of values of THW and TTC collected in the traffic scene including leading and trailing 
vehicles. In this implementation, b = 8 and a = 1. 

so According to the equation, the larger one of a/THW and b/TTC is selected and used as RP 

[0095] The RP map in Figure 27 illustrates, within a THW- (1/TTC) plane, isograms of RP drawn based on the 
equation 8. The horizontal axis represents THW. The horizontal axis is a horizontal line originating at a value of 0.0 on 
the vertical axis and extending in the rightward direction. The vertical axis represents the reciprocal of TTC (1/TTC). 
[0096] Prior to a further description on the RP map in Figure 27, this section provides a brief review of the equation 

55 6 and its RP map in Figure 26. When the vehicle is assumed to be separating from the leading vehicle, the relative 
vehicle velocity is less than zero, and the temi 1/TTC of the equation 6 is less than zero because TTC corresponds 
to D/Vr- According to the equation 6, with the same THW, the RP takes various small values for different minus values 
of 1/TTC. Because the RP takes such small values, the accelerator pedal reaction command AF takes small values, 
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accordingly. above-mentioned influence on the RP when 

rO0971 Accord ng to the equation 8 and the RP map in i-igure d.i , mw auwv^ ^. o ^^i^^to c/tww RP 

value OITHW over dlltei^nt rt-ius «lwes ol 0» reclprecal o( lATO. This provte a gradual reducoon in RP «hei, 

'ro'S to^ «dt7n— , ,h. RP IS indicates o, ,he .a^ltud. o, HsK a«u,l^ ,e. pa.a»,d 

raoTJr It will be appreciated, as an advantage, that the operator normally perceives the risk when the acoeterator 
loC IxpresTng'ln concrete tem^s, upon recognWon of an Increase in the RP by an Increase in ao^lerator Peda. 

01021 in the second embodiment of the third implementation, the equat.on 8 .s used t° P"^^"';.^^^^!''^^^^ 
The third implementation, the first extent (1/TTC) Is heavily weighted than the second extent (in-HW) .n producing 



RP. 



Fourth Implementation of the Invention 

IZn D^lng assS^^^^^^ a mcroprocessor based controller 82D. Controller 82D recedes .nforma- 
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tlon on vehicle separation D between vehicle 70D and a leading vehicle, Information on relative velocity between 
the vehicles, and information on velocity V, of vehicle 70D from the acquired data by laser radar 74 and source of 
vehicle speed 80 of DAS 72D. Controller 82D also receives information on the leading vehicle after processing the 
image data captured by front camera 70. The processing of the image data includes filtering and image pattern rec- 

5 ognition. Such processing may be carried out within or outside of controller 82D. Controller 82D receives current and 
future information ahead of vehicle 70D from communication tool 208. Such infomnation captured by communication 
' toot 208 via antenna 210 will be later described. 

[0108] Using the received information, controller 82D detemnines, by calculation for example, the first extent 1/TTC 
to which vehicle 70D has approached the leading vehicle. Controller 82D determines a period of time Tp in response 

10 ' to the current value of the first extent 1/TTC. and predicts a future value of the first extent the determined period of 
time after as a future environment in a field around vehicle 70D. In this implementation, a risk perceived RP by operator 
expresses the future environment. Based on the RP, controller 82D determines an accelerator pedal reaction command 
AR Command AF is applied to an accelerator pedal reaction characteristic modulator 144. Modulator 144 controls a 
servo motor 146 in response to command AF, thus modulating reaction force versus stroke characteristic of an accel- 

15 erator pedal 152. 

[0109] The flow diagram in Figure 30 illustrates a control routine of the fourth Implementation. The control routine, 
generally indicated at 220, is executed at regular time intervals of 50 milliseconds. 

[0110] At Input box 222, the processor of controller 82D inputs acquired data by DAS 72D. What are read at box 222 
include velocity Vj of the vehicle 70D, vehicle separation D between vehicle 70D and a leading vehicle, relative vehicle 

20 velocity between the vehicles, and velocity Vg of the leading vehicle. 

[01 1 1] At box 224, the processor calculates time to contact (TTC) that Is expressed by the equation 3. As mentioned 
before in the third implementation, time to contact TTC is introduced to quantity a first extent to which the subject 
vehicle 70D has approached to a leading vehicle in the traffic scene illustrated in Figure 2. As is readily seen from the 
equation 3, time to contact TTC indicates how much it takes for the subject vehicle to come into contact with a leading 

25 vehicle. When velocity Vg is higher than velocity Vf, the relative velocity is negative, in this case, time to contact 
TTC is negative. 

[0112] At box 226, the processor determines a period of time x p, which indicates how many seconds to come prior 
to a future environment to be predicted, in response to the time to contact TTC. The period of time Xp is expressed as, 

30 

Xp = f(1/TTC) Eq. 9 

This function involves, as a variable, the reciprocal of TTC. The fully drawn curve in Figure 31 illustrates this function. 
As shown in Figure 31 , the larger the reciprocal of TTC (1/TTC), the smaller the period of time Xp Is. 
^5 [01 13] The period of time Xp corresponds to the magnitude of risk that is felt or perceived by the vehicle operator. In 
the case where time to contact TTC is negative or long so that the first extent (1/TTC) is small, the subject vehicle 70D 
separates sufficiently from the leading vehicle. The current environment in the field around vehicle 70D does not require 
urgent attention by the operator. In such environment, the operator can afford to predict future environment long time 
to come to account for ail available potential risk. Thus, the period of time Xp is long. In the case where time to contact 
TTC is short so that the first extent (1/TTC) is large, the subject vehicle 70D has approached to the leading vehicle. 
The current environment in the field around vehicle 70D indicates the presence of risk in immediate future. In such 
environment, the operator will pay attention to the leading vehicle and cannot afford to predict future environment long 
time to come to account for all available potential risk. Thus, the period of time Xp is short. 

[0114] With continuing reference to the flow diagram in Figure 30, after determining the period of time Xp at box 226, 
the logic goes to box 228. At box 228, the processor inputs the acquired data at communication tool 208. What is read 
at box 228 includes; 

1 . Operating state of a leading vehicle (such as, velocity Vg and acceleration/deceleration) that Is obtained through 
intervehicle communication; and 
^0 2. Traffic condition and road condition In front of the subject vehicle, which are obtained through infrastructure 

communication. 

Th use of intervehicle communication is limited to the case where the leading vehtele has intervehicle communication 

tool. 

55 [01 1 5] At the next box 230, the processor inputs the acquired image data affront camera 76. The image data covering 
the front view of vehicle 70D is subject to image and pattern recognition for he processor to determine the presence 
of a leading vehicle and whether its rear brake lamps are turned "on" or "off". The infomriation as to the state of the 
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hrakelamos is used later for predicling the magnitude Of deceleration Of the leading vehicle. 
foS 6 Tbox S^^^ Predtots d^eleratton XG. of the leading vehicle. If the '-/'"^^f ^ f't^^^^^^^^ 

of perforrriing inten^ehicle comn^unication. the processor inputs the information on deceleration f f e leadmg 
veNcle Z o^ the acquired data through the inten/ehicle communication. If the leadmg vehicle is not capable of per- 
?oS thetei^ehrcommunic^^^^^^ the processor predicts the deceleration XG. in the ^o'-o-ng ^r or not the 
0^^ First the processor determines, out of the acquired image data from the front camera 76, whether or no^ the 
brakriampsotheLading vehicle is turned If this IS thecase.theprocessormeasures.us^^^ 
the elapTe of° 1 when the brake lamps are turned "on". Using the measure of the elapse of time and the var.at^n of 
ve!«iiW V of the leading vehicle, the processor predicts the deceleration XG,. For example, if the measure of the 
e^sJ^onime is less^^^^^^^^ seconds the processor sets a predetemiined value as a virtual deceleration value of 
XCveh^^^^^^^^^^^^ measure of the e.'apse of time is not less than 0.5 ^^l^'^' ^^^^^^ ' 
oredicted value by calculation out of the rate of variation of past values of velocity V3 of the leading vehicle. 

TCedicted deceleration XG. of the leading vehicle is corrected accoun^ng for ho-o^^^^^^^^ 
Of t Jic flow. The homogeneous degree of traffic flow is predicted based on he s su^h th^t the 

mav be obtained at box 228, out of the acquired data from the communication tool 208. The ogic is such that tne 
Zogenelus degree of traffic flow is high when the traffic is congested and the variation of vehicle velocity V, is smalL 
Thrp?ocessor co,r^^ the predicted deceleration XG, in response to the predicted homogeneous degree 0^ traffic 
lot %or e^mZ the processor corrects the predicted deceleration XG3 such that the predicted <lecele ^'on J^a 
d^reasLriThe predicted homogeneous degree of traffic flow increases. This is because a vehic e will not be accel- 
eSed o^dSilerTted greatly when the road is congested and the homogeneous degree of traffic flow .s high. 
tO1 19] AtThJ next block 234. the processor predicts future value of the first extent ^^^J j^^^^J^^ 
usinq the current value of the first extent (TTC) obtained at box 224, the period of time Xp deten^.ned at b°x 226 and 
thTdece'eration XG, predicted at box 232. First, the processor calculates velocrty of the subject veh^le 70D v^^.ty 
of the lead nq vehicle and the vehicle separation between the vehicles. The processor calculates deceleration XG, of 
thrsuSwe'r^OD based on the cuJent velocity V, When it is assumed that deceleration XG, and XG, remains 
unaltered during the period of time ^, future values of V„ and D are expressed as, 

V,(to+Xp) = V,(to) + XG,xXp ^''•■'0 



35 D(VV = °(to)-V,XTp + (1/2)x(XG3-XG,)xXp^ Eq. 12 

Using the results given by calculations of the above equations 1 0-1 2, the processor predicts the future TTC. which is 
expressed as, 

TTC(to+Xp)=D(to+Xp)/{V,(to+Xp)-Va(to+Xp)) Eq. 13 



ToS Z"Z%:^^lor predicts future environment by calculating RP. which ^ expressed as. 

RP = b/TTC(to+Xp) Eq. 14 

[0121] At box 238, the processor uses the RP to detemnine an accelerator pedal reaction command AF, which is 

lS2rl'lTJZT2i, the processor outputs the command AF and applies it to the accelerator pedal reaction 

SlTsr^Sorg t? t^e t^^^^^^^ the pe.od of time Xp is detem^ined as a function of time to contact 

^c LeTo contact TTC is determined based on V., V^. V. and D. Using t»^e information ro^^^^^^^ tSnX decef- 
front camera 76 and communication tool 208, the deceleration of a leading vehicle XG, is predicted U«ng this decel 
e^t on XG a f uLe value of TTC that would occur Xp after is predicted. Risk perceived PR Is detem, ned as afunct.on 
SmeSocalof this future valuer 
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[0124] According to the fourth Implementation, a future value of extent to which vehicle 70D might approach to a 
leading vehicle is predicted from a current value of the extent. This future value of the extent corresponds to the real 
risk perceived or felt by the operator. In this implementation, RP (risk perceived) is indicative of this future value. The 
RP is predicted as a quantity indicative of future environment in a field around vehicle 70D. Accounting for the predicted 

5 RP, the accelerator pedal reaction control is performed. 

[0125] The period of time Xp is used for prediction of a future value of RP. The period of time Xp is variable with the 
extent to which vehicle 700 has approached to the leading vehicle. The faster the vehicle approaches to the leading 
vehicle, the more immediate future is selected for the prediction. This has provided an accelerator pedal reaction control 
that corresponds to the magnitude of risk actually perceived or felt by operator. Like the previously described third 

10 ' implementation, the operator is continuously kept informed of how fast the vehicle is approaching to the leading vehicle 
through the magnitude of reaction force felt during manipulation of accelerator pedal. 

[0126] As different from the third implementation, the deceleration XG^ of the leading vehicle, which is determined 
on the acquired data at front camera 76 and/or communication tool 208, is used. The use of deceleration XGg has 
enhanced prediction of future environment in a manner more closely corresponding to the magnitude of risk actually 
15 perceived by operator. 

[0127] In the fourth implementation, a current value and a future value of time to contact TTC are provided by cal- 
culation of equations involving, as variables, such physical quantities as vehicle speed and vehicle separation. This 
has lead to the minimal number of new components needed for installing a driving assist system in a vehicle. Using 
communiCHlion tool 208 to receive infomiation on deceleration XGg for use in the predication enhances the accuracy 

20 of a futuic value of TTC 

[01 28] In the fourth implementation, both front camera 76 and communication tool 208 are used to determine decel- 
eration XGg. The present invention is not limited to this example. Another example is the use of front camera 76 or 
communication tool 208. Further example is the use of in fomiation provided by laser radar 74 or source of vehicle 
speed 80. A future value of TTC as determined using such deceleration XG^ as predicted is satisfactorily reliable. 

25 [0129] In the fourth implementation, laser radar 74 is used. Such laser radar may be replaced by millimeter radar or 
radar of other type. 

Fifth Implementation of the Invention 

30 [0130] The fifth implementation is substantially the same as the third implementation except the provision of produc- 
ing a selected one of different alert categories to be infomned of via an appropriate alann. Thus, the same technique 
is used in the third and filth implementations in determining TTC and THW. 

[0131] The flow diagram of Figure 32 illustrates a control routine of a first embodiment of the fifth implementation. 
The control routine, generally indicated at 250. is executed at regular time intervals of 50 milliseconds. 
35 [0132] The control routine 250 is substantially the same as the control routine 180 illustrated in Figure 24 in that 
boxes 252, 254 and 256 correspond to boxes 1 82, 1 84 and 1 86, respectively. A description on the boxes 262, 254 and 
256 is hereby omitted for brevity. The following paragraph provides a description on two boxes 258 and 260 that follow 
box 256. 

[0133] In Figure 32, at box 258, the processor of controller 82C (see Figure 20) selects one of alert categories in 
40 response to the RP. various alert categories are stored for different ranges in magnitude of RP. For example, alert 
category elevates as RP increases, in magnitude, into the adjacent higher range from a current range. Each alert 
category may contain the repletion rate of alamn such that the repetition rate of alami elevates with elevation of alert 
category. At output box 260, the processor outputs the selected alert category to the alarm. 

[0134] Setting alert category in response to the RP as described above will keep operator informed of the magnitude 
45 of risk when vehicle has approached to a leading vehicle and/or when Influence due to a predicted future change in 

environment is great. 

[0135] In this embodiment, the RP expressed by the equation 6 has been used. Alternatively, RP expressed by the 
equation 8 or 14 may be used. An example using the equation 14 will be explained below. 

[0136] The flow diagram of Figure 33 illustrates a control routine of a second embodiment of the fifth implementation. 

50 The control routine, generally indicated at 270, Is executed at regular time intervals of 50 milliseconds. 

[0137] The control routine 270 is substantially the same as the control routine 220 illustrated in Figure 30 in that 
boxes 272, 274, 276, 278, 280, 282, 284 and 286 correspond to boxes 222, 224, 226, 228, 230, 232, 234 and 236, 
respectively. A description on the boxes 272, 274, 276, 278, 280, 282, 284 and 286 is hereby omitted for brevity. The 
following paragraph provides a description on two boxes 288 and 290 that follow box 286. 

55 [0138] In Figure 33, at box 288, the processor of controller 82D (see Figure 28) selects one of alert categories in 
response to the RP that has been determined at box 286. Various alert categories are stored for different ranges in 
magnitude of RP. For example, alert category elevates as RP increases, in magnitude, into the adjacent higher range 
from a current range. Each alert category may contain the repletion rate of alarm such that the repetition rate of alarm 
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elevates with elevation of alert category. At output box 290. the processor outputs the selected alert category to the 



[01 39] Setting alert category in response to the RP as described above will keep operator informed of the magnitude 
of risk when vehicle has approached to a leading vehicle and/or when influence due to a predicted future change in 

5 environment is great. . . , j « „„* „t^^ 

[01 401 In the embodiments of the fifth implementation, the repetition rate of alarm has been vaned for different alert 
categories. The invention is not limited to the repetition rate of alami. Another example is to vaiy the volume and/or . 
tone of alarm for different alert categories. Other example is to use various kinds of voice for different alert categories. 

10 Sixth Implementation of the Invention 

[01 41 1 The sixth implementation is substantially the same as the third, fourth and fifth implementations in the use of 
equation 6 in determining the RP. However, according to the sixth implementation, the use of equation 6 is limited to 
provide a new RP, which does not keep operator from operating an automobile 70C (see Figures 20-24) to approach 

15 to a leading vehicle when the vehicle separation D is sufficiently long. 

roi 421 The fully drawn curve in Figure 34 illustrates the varying of RP expressed by the equation 6 with time t when 
the vehicle starts, at zero point (t = 0). approaching to the leading vehicle at the rate of a very low approaching speed 
or 1 0 knVhour For ease of understanding, It is assumed that, during thefirst half from the zero point (t = 0) to a threshold 
moment (t = ta) the vehicle separation D between the vehicles is sufficiently long and the risk actually perceived or 

20 felt by the operator falls in a low risk level range. The second half begins immediately after the threshold moment (t - 
ta). During the second half, the vehicle separation D becomes shorter and shorter and the risk actually perceived by 
the operator grows with respect to time. 

[01431 During the first half, paying much attention mainly to THW, the operator manipulates an accelerator pedal. 
During this first half, the RP expressed by the equation 6 and felt by the operator through the accelerator pedal grows 
25 in response to the reciprocal of THW, whfch the operator pays attention to. The risk actually perceived by the operator 
does not grow in response to the reciprocal of THW. however. Specifically, during the first half, the RP expressed by 
the equation 6 grows at the rate less than the rate at which the risk actually perceived by operator grows. In Figure 34 
the dotted line illustrates the varying of the risk actually perceived by operator during the first half and the subsequent 

transient to the second half. • «■ • ^„ 

30 [01441 According to the sixth implementation, a new risk perceived RP^ is used to compensate for an insufficiency 
provided by the RP expressed by the equation 6. To avoid confusion, the RP expressed by the equation 6 is represented 
by a current risk perceived RPq. 
[0145] Thus, the RP© is expressed as, 

^ RPq = RP = a(1/THW) + b(1/TTC) Eq. 15 

where b and a (b > a) are parameters weighting the first extent (1/TTC) and the second extent (1/THW), respectively, 
such that the second extent (1/THW) is less weighted than thefirst extent (1 /TTC) is. The values of b and a are optimized 
40 after accounting for a statistics of values of THW and TTC collected in the traffic scene including leading and trailing 
vehicles. In this implementation, b = 8 and a = 1 . 

The RPi = (c - THW) + (b/TTC) .Eq- 16 

45 

where b and c are parameters. In this implementation, b = 8 and c = 2.5. ^ ^ „„ • ^ 

[01461 In this implementation, the threshold of THW is 0.5 second (THW = 0.5). When THW > 0.5. the RP, is used. 
When THW S 0 5 the RPn is used. The graph in Figure 35 illustrated this "hybrid" use of two RPq and HP^. In Figure 
35 the one-dot chkin line illustrates the variation of RP, against THW and the fully drawn curve illustrates the vanation 
so of RPo against THW. In this implementation, the BP, is used when THW > 0.5, and the RPq is used when THW s 0.5. 

Seventh Implementation of the Invention 

[01 47] The seventh implementation is substantially the same as the sixth implementation. In this seventh implemen- 
ts tation, another RP2 is used. The RP2 is expressed as, 
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RP2 = d (c - THW) + (aTTHW) + (b/TTC) Eq. 1 7 

where a, b, c and d are parameters. In this implennentation, b = 8, and c = 2.6. 
5 d and a are determined as follows: 

when THW ^0.5: d = 0, a = 1 
when THW > 0.5: d = 1,a = 0. 

^0 Apparently, the equation 1 7 provides the same performance as the equations 15 and 16 provide. 

[0148] Referring to Figure 36, an improved version using the equation 17 is described. According to this improved 
version, the parameters a and d used In the equation 17 are varied continuously in the illustrated pattern in Figure 36 
to provide a smooth transition between two discrete RPq and RP^ that exist in the equation 1 7. In Figure 35, the one- 
dot chain line illustrates the variation of parameter a with respect to THW, and the fully drawn line illustrates the variation 

15 of the parameter b with respect to THW. The fully drawn curve in Figure 37 illustrates the smooth varying of RP5 when 
the parameters a and b are varied as illustrated in Figure 36. 

Eighth Implementation of the Invention 

20 [0149] Figure 38 provides hardware and Figure 39 illustrates how the hardware Is arranged on an automobile 70E. 
[0150] In Figure 38, the reference numeral 40E generally indicates a driving assist system. Driving assist system 
40E is a hybrid including an on board data acquisition system (DAS) 72 and a steering reaction modulation actuator 
84, which are substantially the same as their counterparts in the previously described driving assist system 40A (Figure 
3), and an accelerator reaction modulation actuator 140 and a brake reaction modulation actuator 142, which are 

25 substantially the same as their counterparts in the previously described driving assist system 40B (Figure 5). 
[0151] In Figure 36, driving assist system 40E includes a microprocessor-based controller 82E. 
[0152] Controller 82E recognizes the state of obstacles within environment in a field around vehicle 70E by deter- 
mining velocity Vf of vehicle 70E, relative position and relative velocity between vehicle 70E and each of other vehicles 
within the environment, and relative position between the adjacent lane marking and each of obstacles within the 

30 environment. Based on the recognized obstacle state, controller 82E determines risk which each of the recognized 
obstacles would cause the operator to perceive. Controller 82E divides each of the risks into a longitudinal risk com- 
ponent and a lateral risk component, and sums all of the longitudinal risk components to give a total longitudinal risk 
and all of the lateral risk components to give a total lateral risk. Based on the total longitudinal and lateral risks, controller 
82E determines longitudinal commands and a lateral command. 

35 [0153] Controller 82E outputs the longitudinal commands for application to an accelerator pedal reaction character- 
istic modulator 144 and a brake pedal reaction characteristic modulator 148, respectively. In response to the applied 
longitudinal commands, the accelerator pedal reaction characteristic modulator 1 44 and the brake pedal reaction char- 
acteristic modulator 1 48 control servo motor 146 and brake booster 1 50, thereby modulating the accelerator pedal and 
brake pedal reaction force characteristics. Modulating the accelerator pedal and brake pedal reaction characteristics 

40 prompt the vehicle operator to manipulating an accelerator pedal 152 and a brake pedal 1 54 to appropriate positions, 
respectively. 

[01 54] Controller 82E outputs the lateral command for application to a steering reaction characteristic modulator 86. 
In response to the applied lateral command, the steering reaction characteristic modulator 86 controls servo motor 88. 
Modulating the steering reaction characteristic prompts the vehicle operator to manipulating a steering wheel to an 

^5 appropriate angular position. 

[01 55] The flow diagram in Figure 40 illustrates a control routine of the eighth Implementation of the present invention. 
The control routine, generally indicated at 310, Is executed at regular time intervals of 50 milliseconds. 
[01 56] At input box 312, the processor of controller 82E Inputs acquired data by DAS 72. Specifically, the processor 
inputs vehicle velocity V^, an angular location of a leading vehicle and a vehicle separation D between the subject 

50 vehicle 70E and the leading vehicle. The processor also inputs relative position of the vehicle 70E to the adjacent lane 
mari^ing out of the image data from the front camera 76. The relative position of the vehicle 70E to the adjacent lane 
marking includes a lateral position and an angular position of the vehicle 70E with respect to the lane marking. Out of 
the image data from the front camera 76, the processor further inputs the shape of the lane marking. Out of the image 
data from the front camera 76, the processor still further inputs an angular location of the leading vehicle and a vehicle 

55 separation D between the vehicle 70E and the leading vehicle. Out of the image data from RRS and RLS cameras 
78R and 78L, the processor inputs an angular location of each of vehicles existing in the adjacent lane(s) and a vehicle 
separation between the vehicle 70E and each of the vehicles. The processor also Input velocity of the vehicle 70E from 
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the source of vehicle speed 80. Besides, the processor recognizes the presence of -^^f ^^"^^'^"/^^^^^^^^^^ 
vehicle 70E out of the image data from the front camera 76 and the image data from RRS and RLS '^^'^ J^^^^^ 
rBrR^ognizIng Ihe kTnds of obstacles includes pattern recognition to identify them whether they are a four wheel 

vehicle or a two wheel vehicle or a pedestrian. . ^ ♦u^ w^kj^i^ thp in tprms of 

rai57] At box 314. the processor determines current environment in the f. eld around the vehK^le 70^ 'n ter^J °* 
portion of each of the obstaclesA^ehicles relative to the vehicle 70E direct.on movement °f each of the o^^ -^^^ 
relative to the vehicle 70E. and speed at which each of the obstacles relative to the vehicle 70^. Specifically the 
?o essor iXeS^J: current valu'es of position, direction and speed of each of the obstec e^veh.c.es from the past 
stored values thereof that were determined in the previous cycles and the input data at box 31 2, 
mi581 M box 316 usfng the data on current environment detemilned at box 314, the P^°'=«^^°: "^^'^"'f 
Sn ^^C between the' vehicle 70E and each of the obstacles. TTC, indteates TTC between the vehicle 70E and 
an obstacle k, TTC^ is expressed as, 

Dk ■ q(Dk) Eq. 18 



whore 



Separation (or distance) between the vehicle 70E and an obstacle k; 
Vri, = Relative velocity between the vehfcle 70E and the obstacle k; 
o(Di() - Variance of separation; and 
o(Vrt^) = Variance of relative velocity. 

roi 591 The following several paragraphs provide a description on the variances o(D^) and o(Vrt^). 
S 12 An Vi^or in data might grow should if a sensor or a camera be subject to uncertainty or unforeseeable event^ 
Aiming trhol much such an error might be, variance o, separation a (D,) and variance of -'^^'-^^f '^altef 
te deSned depending upon what an obstacle k is and which sensor or camera is used to recognize the obstade ^ 
mi sT^rr exam Je the laser radar 74 is superior to a CCD camera, which is used as the front camera 76 and RRS 
and RLS camerrVsR and 78L in its capability of providing accurate measure in separation or distance between two 
veicls irrelTcLe of h^^^^^^^^ are separated The cun^es in Figure 41 illustrate the variances of separa.on o 
m sSt fonSer S^^^^^^ and CCD camera, respective^. The CCD camera is used for front camera 76 and RRS and 
Rii carTeras 78R and 78L. As shown in Figure 41 , when laser radar 74 is used to measure a separation D, b^een 
the vehtefe 70E and^^^^^ k in the fom, of an automobile, variance o(D,) is kept <=°"^l«"\.°^^: f 

vies in The separation to be measured. When the CCD camera is used to measure the separa^on D„ vanance o 
S eases e'^^^^^^^^^^^^^^^ When the separation D, is less 

Letter accuracy than laser radar 74 does, and variance o(D,) for CCD J^f^j*^;^^^^^^^^^ a d CCD 

10162, THecu.eslnF^u.42in^^^^^^^^^^^^^^ 

::S7ranraf obi^^^^^^ an rutomobTe variance o(V,) increases lineariy as the relative velocity 

Jolea, using pattern recognition technique, image data from front camera 76 and ^^-^^ RL^^^^^^ 
78L are analyzed by the processor to detemiine what an obstacle k is. A famjy of curves ,n Figure 43 ^'"^trate^ t^« 
ir<s =«t fr,r rco camera A family of cun/es In Figure 44 Illustrates the variance o(Vrt,) set for CCD camera. 
;Tur wheSihC a^?wo wTe: veMc'i: a pedestrian an'd lane markings were selected and used as an obstacle k 

s;6rwhe:the?:cD%''r^^^^^^^ 

oTrneasurement is. Accordingly, as shown in Figure 43. the variance o(D,) for measunng separation from a four wheel 
vehicle is less than that for measuring separation from two wheel vehtole or pedestnan. , . ^ , ... 

?01651 When t'e CCD camera is used to measure the relatK,e velocity M^, the variance o(V^) is determined de^ 
^end!igoMhe"magnitudeofrelativevelocitywhichmaybeassumedforthe^^ 

in Fiqure 44 the higher the assumed relative velocity, the larger the vanance a (V^,) is. Comparing ^^'^tive vewciv 
rJrid tor' four wheel vehicle to that assumed for two wheel vehicle or that assumed for pedestnan, the fomier is 
hfgheT^an the^la^ri^^ the variance o(V.) for four wheel vehicle is set greater than that for two wheel 

mi'Sl "XrS meTariance o(D^ for lane mari<ing is set less than those for four wheel vehicle two wheel 
Sardp^eLln.^nR 
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two wheel vehicle and pedestrian. 

[0167] With reference again to the flow diagram in Figure 40, after calculating TTCk at box 316, the logic goes to 
box 318. At 318, the processor uses TTCk to calculate risk perceived RP^, which an obstacle k would cause operator 
to perceive. RP^ is expressed as, 

5 

10 where, 

Wk = Weighting component applied to the obstacle k. 

Various values are set as weighting component for different obstacles in kind. For example, when a four wheel, a two 
wheel vehicle or a pedestrian is an obstacle k, the operator would be influenced most upon approaching to such 
obstacle k. Thus, in this implementation, W^ = 1 , when obstacle k is one of a four wheel, a two wheel vehicle and a 

15 pedestrian. When lane marking is an obstacle k, the operator would be influenced less upon approaching to the lane 
marking. Thus, In this implementation. Wk = about 0.5, when obstacle k is lane marking. Operator would be influenced 
less upon approaching to lane marking beyond which lies a railroad or a wall or a fence than one would be influenced 
upon approaching to lane marking beyond lies the adjacent lane. Thus, different values may be set as W^ depending 
upon where the lane marking exists. 

20 [0168] Lane markings are distributed within a range of angular locations ahead of the vehicle 70E. Risk with regard 
to lane markings is determined by integrating RP^ over the whole range of angular locations. Risk perceived RP|ane 's 
expressed as, 
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lane = /(TT^^W|ane)dL Eq. 20 

' '^lane 

where 

Wtane = Weighting component 

30 [01 69] With continuing reference to Figure 40. at box 320, the processor sums longitudinal components of individual 
risk perceived RPk including risk with regard to lane markings RP|ane ^ provide a total longitudinal risk RPLongftudinai- 
The total longitudinal risk RPLongftudinai *s expressed as, 



35 



50 



RpLongltumnai - ^RP^COsA ^Q- 21 



where, 

40 Gk = Angular location of an obstacle k as viewed from the vehicle 70E G^=0 when the obstacle k is located in front of 
the vehicle, 1 80 when the obstacle k is located behind the vehicle. 

[0170] At the next block 322, the processor sums lateral components of individual risk perceived RPk including risk 
with regard to lane markings RP|ane provide a total lateral risk RPtaterai- "^h® ^o*®' longitudinal risk RPtateraJ ex- 
pressed as, 

45 

RPtaterai = ^RP^sine. Eq. 22 



[0171] At box 324, the processor determines longitudinal commands by referring to the relationship shown in Figure 
45 and the relationship shown in Figure 46 using the total longitudinal risk RPLongftudinai- One of the longitudinal com- 
mands, namely, an accelerator pedal reaction command F;^, is provided to modulate an accelerator pedal reaction 
characteristic. The other command, namely, a brake pedal reaction command Fb, is provided to modulate a brake 
55 pedal reaction characteristic. They provide such a relationship that, when the total longitudinal risk RP Longitudinal '^i- 
creases, the accelerator pedal reaction command F;^ increases, prompting operator to releasing the accelerator pedal 
1 52, while the brake pedal reaction force Fg decreases, prompting the operator to depressing the brake pedal 1 54. 
[01 72] The fully drawn line in Figure 46 illustrates the relationship between the accelerator pedal reaction command 
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and the total longitudinal risk RP,..,«..i„a, As will be readily .een from Figure ^; '^^^^'^^J'^^^^^^ 
when RP. , is less than a first threshold RPo- When RPLongitudinai exceeds the first t^'-^^f '^^^^^ 

resrthanlTe^^rd threshold RP_ that is greater than the first threshold ^Po /^^l^--^^^^^^^^^ *° 
RP The command F. takes the maximum when RPtongHudinai exceeds the second threshold "»"max- 

reaction force to the minimum. When RPLonstudinai 'S "Oi greater uidn 

is zero, leaving the brake pedal reaction characteristic ""al^/ed-^ ^^t^, than the threshold 

moT<S,«;orTiSf A. K'^^e me WKe ^ reaClon .o»o ^ reduced, a.o».ng m. braKe ped« » Pe 

"f^Laierai! ' p. 47 provides the relationship between the total lateral nsK 

to reduce the nsk RPtaterai- > he fully drawn line in rigur*. h positive when risk on 

Fsmax When the total lateral nsk RPLaterai 9'^^^'°; ' . . =_ ^^.^ leaving steering reaction characteristte unaltered, 
lateral risk RP^. , Is in the ^'-^V -^^^ Trase^theTmlrFs noreases with the increasing total lateral 
Sub^quentV^hent^^^^^^^^^ 

?3 rv-rlhrm";^^^^^^^^^^^ AS the S,mmand F3 '""o^^^^^^^^^^^^ reaction force to 

lui //I vvun ooiiiiiiu u greater than a left-turn threshold -RPmax- 

tum reaction -Fs„ax when the total lateral nsk RPutera. 'f^'®^^'"°" " „^ = leaving steering reaction char- 

When the total lateral risk RP^^ is in the v.cin.^ of zero the ^onnrnand Fs is decreases with the 

acteristic unaltered. Subsequently, when the total lateral nsk RP^^«, decreases J;^"^';;,^^',^^^.,,,^ t.^eghold 
decreasing total lateral risk HP^,^, When the total lateral nsk RPuterai 2^"^' '° "^'^"^J"^" dec eases from zero. 
RP the command Fs stays at the maximum left-turn reaction -Fsn«x- As the command Fg 

p~annerto Ce St uThTsk com'ponents. /his may be readily confimned by referring to ^^-^^^^^Tn 
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to operating the vehicle 70E in a direction toward where the longitudinal and lateral risks RPtongiiudinai RPLaterai 
are lowered. 

[0181] With reference to Figures 38 to 47, the eighth implementation of the present invention has been described. 
This implementation provides features as follows. 

5 

(1) As information on environment in a field around the vehicle 70E, the controller 82E detemiines the presence 
of all of obstacles, including a leading vehicle, a trailing vehicle, a vehicle in the adjacent lane, a pedestrian, and 
lane markings. The controller 82E calculates, for each of the obstacles, a risk RPk- Accounting for the risks RP^ 
from all directions of the vehicle 40E. the controller 82E allocates commands F^, Fq, and Fs for prompting the 

10 ' vehicle operator to operating the vehicle 40E longitudinally and laterally in a direction appropriate to cope with the 
available risks RPk. It will be appreciated that this implementation provides an appropriate assist to the vehicle 
operator. 

(2) The controller 82E provides an appropriate assist to manual effort to operate the accelerator pedal by modulating 
or altering accelerator pedal reaction in response to the detemnined command F^^. 

15 (3) For each of the obstacles, the controller 82E calculates TTCk by dividing separation by relative velocity \J^, 

and determines risk RP^ as a function of the reciprocal of TTCk- This risk RP^ represents an extent how quickly 
the vehicle 70E has approached to the obstacle k. This implementation provides an appropriate assist to the vehicle 
operator to opening the vehicle 70E longitudinally and laterally in response to the extent how quickly the vehicle 
70E has approached to Ihe obstacle k. 

20 (4) As is indicated by equation 18, 



25 



determining TTC^ involves variance of separation <y(D^) and variance of relative velocity o(\/^). In use of laser 
radar 74, the variances o(D^^) and a(Vrk) are subject to the Illustrated varying In Figures 41 and 42. In use of CCD 
camera, the variances a(Dk) and o(Vrtc) are subject to the Illustrated varying in Figures 43 and 44. Employing the 
variances a(Dk) and in determining TTCk allows use of diverse radars and cameras in on board DAS 72. 

30 (5) As is indicated by equation 1 9, 



35 

determining RP^ involves weighting component W^. The weighting component takes an appropriate value that 
has been selected out of various values predetermined for different kinds of obstacles and for different surroundings 
of lane marking. Employing the weighting component in detemriining RP^ allows diverse obstacles to be proc- 
essed in determining commands F^, Fb and Fs- 
40 (6) With respect to the vehicle 70E, angular locations of all of the obstacles cause the controller 82E to calculate 

longitudinal and lateral risk components and provide appropriate allocation of various commands F;^, Fg and Fq 
to the longitudinal and lateral risks. Accordingly, the controller 82E allocates commands F^, Fg and Fg to prompting 
operator to operating the vehicle longitudinally and laterally in accordance with the angular locations of the obsta- 
cles. 

45 (7) The controller 82E provides an appropriate assist to manual effort to operate the steering wheel by modulating 

or altering steering reaction In response to the determined command Fg. Further, the controller 82E provides an 
appropriate assist to manual effort to operate the brake pedal by modulating or altering brake pedal reaction in 
response to the detennined command Fg. 

(B) For each of the obstacles, the controller 82E calculates risk RP^ to calculate longitudinal and lateral risk com- 
50 . ponents RPLongitudinai ^nd RPLaierai- response to the longitudinal and lateral risk components, the controller 82E 
allocates commands F^^, Fg and Fg for prompting operator to operating the vehicle 70E longitudinally and laterally 
in an appropriate manner to cope with such risk components. In this implementation, therefore, the driving system 
provides assist the operator in prompting to operating the vehicle longitudinally and laterally in response to distri- 
bution of individual risks RP^. In this implementation, the controller 82E determines RP^ as a function of the recip- 
55 rocal of TTCk- Therefore, the driving system assist the operator in prompting to operating the vehicle longitudinally 

and laterally in response to the extent how quickly the vehicle has approached to the obstacle k. 

[0182] In this implementation, the controller 82E uses the equation 1 9 to detemiine RP^ as a physical quantity quan- 
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tifvina the extent how quickly the vehicle 70E has approached to an obstacle k. The invention is not limited to the use 
SlTon?9 to quantify the extent how quickV the vehicle 70E has approached to an obstacle A"y aPp^iat^ 
physical quantity may be used in quantifying the extent how quickly the vehicle 70E has approached to an obstacle k. 

Ninth Implementation of the Invention 

[0183] The ninth implementation is substantially the same as the eighth ^'"bodiment illustrated in Figures 38 to ^^^^ - 
0 S Turning back to Figures 38 and 39. Figure 38 provides hardware of the nmth implementation and Figure 39 
illustrates how the hardware is arranged on an automobile 70E according to the ninth implementation. 

in ^e ninth ir^^^^ rr^icroprocessor-based controller 82E recogn^es the state otp^stacles withjn ■ 

enXonment in a field around vehicle 70E by detemilnlng velocrty V, of vehicle 70E. relative position and relajve velocity 
betwervehicle 70E and each of other vehicles within the environment, and relative position between the adjacent 
lanrmarking and e^^^^ of obstacles within the environment. Based on the recognized obstacle state controller 82E 
iteies hsk lich each of the recognized obstacles would cause the operator to perceive. Controller 82E predicts 
fch^rrn ik RP^^^^^^ to a cSange in operator input. Controller 82E calculates a change in total longrtudma 

nsk rlsponJe " a change in operator input for longitudinal operation of the vehicle 70E and a change in total lateral 
risk In TZonZ !o a change in operator input for lateral operation of the vehicle 70E. Based on the cateulated changes 
in total longitudinal and lateral risks, controller 82E detemiines longitudinal and lateral commands. 
roiMl controller 82E inputs the information on the current operator input for longitudinal operation of the vehicle by 
detSLq poSions of an accelerator pedal 152 and abrake pedal 154 (see Figure 39). Stroke sensors may be used 
rrersure the positions of such pedals. The positions of such pedals may be detem,ined from the state of a sen,o 

St c modulator 144 and a brake pedal reaction characteristic modulator 148. respectively. In response to the apf^ied 
rairudt.Tommands the acceLator pedal reaction characteristte modulator 144 and the brake pedal reaction char- 
acSc IduTaTor^^^^^ control se^o motor 146 and brake booster 1 50, thereby modulating the acceler^or pedal and 
Seledal reaSion force characteristics. Modulating the accelerator pedal and brake pedal reaction character«t«j 
prompt ^e -hLe operator to manipulating the a^^^^ 

[oiMf 'Sntroller 82E outputs the lateral command for application to a steering reaction characteristk: modulator 86. 
S reSonseHe applied lateral command, the steering reaction characteristic modulator 86 controls servo mo or 88^ 
ISITg t^ster^ reaction characteristic prompts the vehicle operator to manipulating the steering wheel to an 

Krih:;rjrgr:rnFigure48i 

Vhe control routine, generally indicated at 340, is executed at regulartime '"Nervate of 50 milliseconds^ 
01911 The control routine 340 is substantially the same as the control routine 31 0 in Figure 40 m that boxes 342, 
£lt 346ll;d£8TnRgure48arethesameastheboxes312,314,316an^ 
the detailed description on the boxes 342, 344. 346 and 348 is hereby omitted for brevity. 
101921 in Figure 48, after the box 348, the control logic goes to box 350. 

0 93 Atinputbox350,theprocessorinputsinfomiationoncurrentoperatorinputthroughthedepressedangte 
LVaielerat^r pedal 152 and/or brake pedal 154 and through the manipulated angle of steenng wheel. When the 
o:i^Tr^\X^es the accelemtor pedal 1 52. the processor uses the depressed angle of the accelerator pedal 1 52 
rtrderesseitngle e,,. When the operator manipulates the brake pedal 154. the processor uses the depressed 
anale of the brake oedal 1 54 as the depressed angle 6;^. . . ♦ o 

mmi AUhe nex' box 352, the processor predicts a change in RP, in response to a change m opera or mput^Spe- 
Sf cal y based on the current RP, detemiined at box 348 and the current operator input received at box 350 the 

?o"Srwithtferrce to Figure 49. with regard to the operator input for operating the vehicle in the bng.tudmal 
direct on The p" cessor predicts an increase in vehicle velocity when there is an increase by a variation AAB from the 
curroraccelerator/brake pedal depressed angle GAB and it also predicts a decrease in vehicle velocity when there is 
a d^l^TbyTe vtiation AAB from the current accelerator/brake pedal depressed angle OAS. Based on the predicted 
fnc^asrand decrease in vehicle velocity, the processor calculates the new values of RP, using the equation 19. In 
other words, the processor predicts one new value of RP^ after the vehicle velocrty undergoes t^^ P-d.cted jncre^^^^^^ 
andtheothernewvalueofRP.afterthevehiclevelocityundergoesthepredfcted decrease. Tumingback^ 

19 RP °is detem,ined as a function of the reciprocal of TTC, that is detemiined as a function of rela ive velocrty Vh,. 
F^m thfe expZtion. it is clear that a change in vehicle velocity causes a change in vehicle velocrty which .n tum 
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causes a change in RP^. 

[01 96] For ease of description , it is hereby assumed that the accelerator/brake pedal depressed angle 6AB increases 
when the accelerator pedal 152 or brake pedal 154 is manipulated in a direction to cause an increase in RP^. For 
example, it is considered that there is an increase in accelerator/brake pedal OAB when there is an increase from the 
5 current value of depressed angle of the accelerator pedal 152 or there Is a decrease from the current value of depressed 
angle of the brake pedal 154. 

[01 97] With continuing reference to Figure 49, with regard to the operator input for operating the vehicle In the lateral 
direction, the processor predicts a change in heading direction of the vehicle when there is an increase by a variation 
AS from the current steering angle 6S and it also predicts a change in heading direction of the vehicle when there is 

id a decrease by the variation AS from the current steering angle 6S. Based on the predicted changes in heading direction 
of the vehicle, the processor calculates new angular locations of each obstacle k and new values of RP^. If there is a 
change in heading direction, there is a change in separation between the vehicle and each obstacle and a change in 
angular location of the obstacle. Accordingly, a change in steering angle causes a change in RP^. In Figure 49, when 
the steering is in neutral position, GS is zero. GS is positive upon manipulating the steering wheel to the right, and it is 

15 negative upon manipulating the steering wheel to the left. 

[01 98] The magnitudes of the variations AAB and AS are detemiined taking into account changes in pedal depressed 
angle and in steering angle per each processing time, which changes would normally occur during normal operation 
of the vehicle. In this Implementation, the one processing time is, for example, from 0.1 to 0.2 seconds. The processing 
time differs depending on the kind of vehicle and on the type of processing to be completed. If the processing time 

20 ranges 0.1 to 0.2 seconds, AAB and AS are 10 mm and 0.6 degrees, respectively. The variances are not limited to 
such fixed values. By using learning technique, the average of depressed angles of accelerator/brake pedal and the 
average of manipulated steering angles over one driving cycle may be set as the variances AAB and AS for the next 
driving cycle. 

[0199] With reference again to the flow diagram in Figure 48, at box 354, the processor calculates a change in 
^5 R ^Longitudinal- Based on RP,^ determined at box 348 and its predicted new values detemnined at box 352, the processor 
detennines the cun-ent total longitudinal risk RPLongitudinai(O)' ^ value of total longitudinal risk RPLongstudinaiW 
GAB + AAB, and the other new value of total longitudinal risk RPLongitrudinai(-) ^^r GAB - AAB. The cu n-ent total longitudinal 
risk RPLongitudinai(O) expressed as, 

30 

RPtonglwdinaiCO) = ^/CAcosa Eq. 23 

Using the equation 21 , the processor detemnines the new value of total longitudinal risk RPLongHudinai W ® ^B + AAB, 
35 and the other new value of total longitudinal risk RPLongitrudinai(-) ®AB - AAB. Figure 50 illustrates the relationship 
between the current and two new values of total longitudinal risk. 

[0200] At the next box 356, the processor calculates a change in RPLaterai- Based on RP^ determined at box 348 
and its predicted new values detemnined at box 352, the processor determines the current total lateral risk RP|_aterai 
(0), a new value of total lateral risk RPLaterai(+) GS + AS, and the other new value of total lateral risk RPLaterai(') 
40 GS - AS. The cunrent total lateral risk RPuterai(O) 's expressed as, 

RPuteral(O) = ^RP.smA ^Q. 24 

45 

Using the equation 22, the processor detennines the new value of total lateral risk RPLaterai(+) f^'' + AS, and the 
other new value of total lateral risk RPLateral(') ' Figure 51 illustrates the relationship between the current 

and two new values of total lateral risk. 

[0201] At box 358, the processor detennines longitudinal commands including a set of accelerator pedal reaction 
50 commands Fa(0), Fa(-) and Fa(+), and a set of brake pedal reaction commands Fb(0), Fb(-) and Fb(+). The processor 
detennines accelerator pedal reaction commands Fa(0)» Fa(-) referring to the relationship illustrated in 

Figure 52 using RPLongitudinai(O). RPLongitudinai(-) ^"^1 RPLongitudinai(+). respectively The fully drawn line in Figure 52 is 
substantially the same as that in Figure 45. The processor determines brake pedal reaction commands Fb(0), FgC-) 
and Fg(+) by referring to the relationship illustrated in Figure 53 using RPLongitudinaj(Q)' ^^PtongitudinaK") ^^Longitudinal 
55 (+), respectively The fully drawn line in Figure 53 is substantially the same as that in Figure 46. 

[0202] At box 360, the processor determines a set of lateral commands Fs(0), Fs(-) and Fs(+) by referring to the 
illustrated relationship in Figure 54 using RPLaterai(O). RPLaterai(-) ^"^1 RPtateraiW- respectively The fully drawn line in 
Figure 54 is substantially the same as that In Figure 47. 
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[0203] At output box 362. the processor outputs longitudinal and lateral comnnands determined at boxes 358 and 
360 These commands include a set of accelerator pedal reaction commands Fa(0), Fa(-) and Fa(+) for application to 
an accelerator pedal reaction characteristic modulator 144 (see Figure 38). They also include a set of brake pedal 
reaction commands Fb(0), Fb(-) and FgW for application to a brake pedal reaction characteristic modulator 148 (see 
5 Figure 38). They further include a set of lateral commands Fs(0), Fs(-) and Fs(+) for application to a steering reaction 
characteristic modulator 86 (see Figure 38). 

[0204] With reference to Figure 38, in response to the commands Fa(0), Fa(-) and Fa(+) from the controller 82E, the - 
accelerator pedal reaction characteristic modulator 1 44 controls a senro motor 1 46 to modulate or alter the accelerator 
pedal reaction characteristic as shown in Figure 55. In Figure 55, broken line indicates the usual accelerator pedal 

10 reaction characteristic. At OAB. the accelerator pedal reaction is increased from the level on the usual reaction char- - 
acteristic by Fa(0). Upon manipulating the accelerator pedal from the current depressed angle toward eAB - AAB, the 
operator feels reaction force increased from the level on the usual reaction characteristic by Fa(-). Upon manipulating 
the accelerator pedal from the current depressed angle toward GAB + AAB, the operator feels reaction force increased 
from the level on the usual reaction characteristic by Fa(+). From a change in reaction force, the operator can recognize 

15 how the cun-ent risk will vary upon moving the accelerator pedal from the cun-ent position. 

[0205] In response to the commands Fb(0). Fb(-) and Fb(+), the brake pedal reaction characteristic modulator 148 
controls a brake booster 150 to modulate or alter the brake pedal reaction characteristic as shown in Figure 56. In 
Figure 56, broken line indicates the usual brake pedal reaction characteristic. At eAB, the brake pedal reaction is as 
high as the level on the usual reaction characteristic because Fb(0) = 0. Upon manipulating the brake pedal from the 

20 current depressed angle toward eAB - AAB, the operator feels the usual reaction force because Fb(-) = 0. Upon ma- 
nipulating the brake pedal from the current depressed angle toward eAB + AAB, the operator feels reaction force 
decreased from the level on the usual reaction characteristic by Fb(+). From a change in reaction force, the operator 
can recognize how the current risk will vary upon moving the brake pedal from the cunrent position. 
[0206] In response to commands Fs(0), Fs(-) and Fs(+). the steering reaction characteristic modulator 86 controls 

25 a servo motor 88 to modulate or alter the steering reaction characteristic as shown in Figure 57. In Figure 57, broken 
line indicates the usual steering reaction characteristic. At eS, the steering reaction is increased from the level on the 
usual reaction characteristic by Fs(0). Upon manipulating the steering wheel from the current angular position toward 
eS - AS the operator feels reaction force increased from the level on the usual reaction characteristic by f^{-). Upon 
manipulating the steering wheel from the current angular position toward GS + A S, the operator feels reaction force 

30 increased from the level on the usual reaction characteristic by f^(+). From a change in reaction force, the operator 
can recognize how the cunrent risk will vary upon turning the steering from the current position. 
[0207] From the preceding description, it will now be understood that the eighth and ninth implementations provide 
the same features. However, the ninth implementation provides a feature which the eighth implementation does not. 
According to the ninth implementation, gradient of reaction force is created across the current position of operator input 

35 so as to prompt the operator to selecting a desired change from the current position of the operator input to reduce 
the risk. 

Tenth Implementation of the Invention 

40 [0208] The tenth implementation is substantially the same as the eighth embodiment illustrated In Figures 38 to 47. 
[0209] Turning back to Figures 38 and 39, Figure 38 provides hardware of the tenth implementation and Figure 39 
illustrates how the hardware is arranged on an automobile 70E according to the tenth implementation. 
[0210] In the tenth implementation, a microprocessor-based controller 82E recognizes the state of obstacles within 
environment in a field around vehicle 70E by detennining velocity Vf of vehicle 70E, relative position and relative velocity 

45 between vehicle 70E and each of other vehicles within the environment, and relative position between the adjacent 
lane marking and each of obstacles within the environment. Based on the recognized obstacle state, controller 82E 
determines individual risk which each of the recognized obstacles would cause the operator to perceive. Controller 
82E sums all of the individual risks to give a total risk. Controller 82E determines an angular location in which the total 
risk originates. In response to the determined angular position, controller 82E detemnines gains to be applied to a total 

50 longitudinal risk and to a total lateral risk. Based on the gains and the total longitudinal and lateral risks, controller 82E 
determines longitudinal and lateral commands. 

[0211] Controller 82E outputs the longitudinal commands for application to an accelerator pedal reaction character- 
istic modulator 144 and a brake pedal reaction characteristic modulator 148, respectively In response to the applied 
longitudinal commands, the accelerator pedal reaction characteristic modulator 144 and the brake pedal reaction char- 
55 acteristic modulator 148 control servo motor 146 and brake booster 1 50, thereby modulating the accelerator pedal and 
brake pedal reaction force characteristics. Modulating the accelerator pedal and brake pedal reaction characteristics 
prompt the vehicle operator to manipulating the accelerator pedal 1 52 and the brake pedal 1 54 to appropriate positions, 
respectively. 
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[0212] Controller 82E outputs the lateral command for application to a steering reaction characteristic nnodulator 86. 
In response to the applied lateral comnnand, the steering reaction characteristic nnodulator 86 controls servo motor 88. 
Modulating the steering reaction characteristic prompts the vehicle operator to manipulating the steering wheel to an 
appropriate angular position. 

5 [0213] The flow diagram in Figure 58 illustrates a control routine of the tenth implementation of the present invention. 
The control routine, generally indicated at 370, is executed at regular time intervals of 50 milliseconds. 
[0214] The control routine 370 is substantially the same as the control routine 310 in Figure 40 in that boxes 372, 
374. 376, 378, 380 and 382 in Figure 58 are the same as the boxes 312, 314, 316, 318. 320 and 322 in Figure 40, 
respectively Accordingly, the detailed description on the boxes 372, 374, 376, 378, 380 and 382 is hereby omitted for 

10 brevity. 

[0215] In Figure 58, after the box 382, the control logic goes to box 384. At box 384, based on the total longitudinal 
risk RPLongitudinai determined at 380 and the total lateral risk RPuterah processor calculates an angular location 
<I>AIJ- ''^ which a combined risk originates. The angular location ([^all 's expressed as, 

15 op 

. ^-^ "'^Lateral oc 

Longitudinal 

When the combined risk originates in an angular location ahead the vehicle, <^pj^ = 0 degree. When it originates in an 
20 angular location behind the vehicle, (|»all = ^0 degrees. When it originates in an angular location on the right hand or 
left hand side of the vehicle. I())all' = 90 degrees. 

[0216] At the next box 386, the processor determines gains GLopgHydinai and GLaterai by refen-ing to the illustrated 
curves in Figure 59 using the absolute value I(1>allI at box 386. In Figure 59, the horizontal axis represents the absolute 
value of while the vertical axis represents gain. The gain G Longitudinal 1 when the absolute value Ic^^ll' less 

25 than a value that is less than 90 degrees. This is the case where the combined risk originates ahead of the vehicle. 
The gain GLongitudinai drops from 1 toward zero when the absolute value Ic^^lJ exceeds the value At 90 degrees, 
the gain GLongjtudinai 's zero. This is the case where the combined risk originates form the side or from behind. 
[0217] With continuing reference to Figure 59, the gain GLaterai at about 90 degrees. This is the case where the 
combined risk originates on the lateral side of the vehicle. At 0 and 180 degrees, the gate GLatrai drops down to zero. 

30 [021 8] At box 388, the processor determines an accelerator pedal reaction command Fp, and a brake pedal reaction 
Fb in the same manner as the processor did at box 324 in Figure 40. As different from box 324, the processor multiplies 
^Longitudinal With each of F^ and Fb at box 388. 

[0219] At box 390, the processor determines a steering reaction command Fs in the same manner as the processor 
did at box 326 in Figure 40. As different from box 326, the processor multiplies GLateraii with Fs at box 390. 
35 [0220] At box 392, the processor outputs the commands determined at boxes388and 390 for application to modu- 
lators 144, 148 and 86 (see Figure 38). 

[0221] In the tenth implementation, gains GLongitudinai ^"^1 GLaterai ^^e detemnined for longitudinal commands and for 
lateral command. These gains are set in accordance with curves illustrated in Figure 50. With the use of such gains, 
the controller can allocate commands for prompting the operator to extensively coping with risks in an angular location 

40 where the combined risk originates. 

[0222] While the present invention has been particularly described, in conjunction with various implementations of 
the present invention, it is evident that many alternatives, modifications and variations will be apparent to those skilled 
in the art in light of the foregoing description. It is therefore contemplated that the appended claims will embrace any 
such alternatives, modifications and variations as falling within the true scope and spirit of the present invention. 

45 [0223] This application claims the priorities of Japanese Patent Applications No. P2001 -252422, filed August 23, 
2001, No. P2001-389314, filed December 21, 2001, No. P2002-1 38266, filed May 14, 2002. and No. P2002-1 77029. 
Filed June 18, 2002, the disclosure of each of which is hereby incorporated by reference in its entirety. 



50 Claims 

1 . A driving assist system for assisting effort by an operator to operate a vehicle in traveling, the driving assist system 
comprising: 

55 a data acquisition system acquiring data including information on vehicle state and information on environment 

in a field around the vehicle; 

a controller, mounted to the vehicle, for receiving the acquired data, for determining future environment in the 
field using the acquired data, for making an operator response plan in response to the determined future 
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environment, which plan prompts the operator to operating the vehicle in a desired manner for the detenn.ned 
future environment, to detemiine command, and for generating th- .^mand; and 

at least one actuator, mounted to the vehicle, for prompting the or .or in response to the command to op- 
erating the vehicle in the desired manner. 

2 The driving assist system as claimed in claim 1 . wherein the infomnation on environment involves infomiation on 
the presence of obstacles in the field; wherein the determined future environment involves a risk whch each o 
the obstacles would cause the operator to perceive; and wherein the operator response plan is made to prompt 
the operator to operating the vehicle in the desired manner to reduce the nsks. 

3 The driving assist system as claimed in claim 2. wherein the information on environment involves in^o^^aticn on 
road condition; wherein the detemiined future environment involves a risk derived from the road condrtion, which 
is determined by a lateral deviation of the vehicle from a lane and by cun/ature of the lane; and wherein the operator 
response plan is made to prompt the operator to operating the vehicle in the desired manner to reduce the risks 

IS superimposed by the risk derived from the road condition. 

4 The driving assist system asclaimed in claim 1 . wherein the operator response plan includes the amount of input 
to the actuator, and wherein the actuator is capable of modulating reaction characteristic to manual effort by the 
Operator. 
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5. The driving assist system as claimed in claim 1 , wherein the information on environment involves information on 
the presence of a leading vehicle ahead in the same lane on a road in the field. 

6 The driving assist system as claimed in claim 5. wherein the controller uses infomnation of velocity (V,) of the 
vehicle, velocity (VJ of the leading vehicle and relative vehicle velocity (V,) in detenmining future environment .n 
the field. 

7. The driving assist system as claimed in claim 5. wherein the detemiined future environment includes a relative 
positional relation between the vehicles. 

8. The driving assist system as claimed in claim 6, wherein the detemiined future environment includes a relative 
position between the vehicles 

9. The driving assist system as claimed in claim 1 . wherein the actuator is capable of modulating reaction character- 
35 istic to manual steering effort by the operator. 

10. The driving assist system as claimed in claim 1 . wherein the actuator is capable of modulating reaction character- 
istic to manual effort applied onto an accelerator of the vehicle by the operator. 

1 1 . The driving assist system as claimed in claim 1 , wherein the actuator is capable of modulating reaction character- 
istic to manual effort applied onto a brake of the vehicle by the operator. 

12. A driving assist system for assisting effort by an operatorto operate a vehicle in traveling, the driving assist system 
comprising: 

a data acquisition system acquiring data including Infomnation on vehicle state and infomiation on enviror,r,-.ent 
in a field around the vehicle, the infonnation on environment involving infonnation on the presence of ob;>iacles 

r<l^ntroller. mounted to the vehicle, for receiving the acquired data, for detemiining future environment in the 
field the determined future environment involving a risk which each of the obstacles would cause the operator 
to perceive, for making an operator response plan In response to the detemiined future environment which 
plan prompts the operator to operating the vehicle at least longitudinally to reduce the nsks. to detem^ine 

commands, and for generating the commands; and 

a plurality of actuators, mounted to the vehicle, for prompting the operator in response to the commands to 
operating the vehicle at least tongitudinally. the plurality of actuators includes an accelerator reaction modu- 
lation actuator capable of modulating reaction characteristic to manual effort applied onto an accelerator of 
the vehicle. 
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1 3. A driving assist system for assisting effort by an operator to operate a vehicle in traveling, the driving assist system 
comprising: 

a data acquisition system acquiring data involving information on the presence of a leading vehicle in a field 
around the vehicle; and 

a controller, mounted to the vehicle, for receiving the acquired data, for determining a first extent (1/TTC) to 
which the vehicles has approached to each other and a second extent (1 /THW) to which the first extent (1/TTC) 
might be influenced if a change in environment should occur, and for detenmining future environment (RP) in 
the field based on the first and second extents (1/TTC, 1/THW). 

14. The driving assist system as claimed in claim 13, wherein, in detennining the first and second extents (1/TTC, 
1/THW), the controller uses a velocity of the vehicle (Vf), a velocity of the leading vehicle (Vg), and the vehicle 
separation (D). 

15. The driving assist system as claimed in claim 14, wherein the first extent is a first risk category (1/TTC), and the 
second extent is a second risk category (1/THW). 

16. The driving assist system as claimed in claim 13, wherein the controller makes an operator response plan in 
response lo Ihc dclcrmined future environment to determine a command and generates the command; and further 
compiising an ctccclerrttor reaction modulation actuator capable of modulating reaction characteristic to manual 
effort applied onto an accelerator of the vehicle by the operator in response to the command. 

17. The driving assist system as claimed in claim 13, wherein the controller has various alert categories with different 
environment categories and selects one of the alert categories for the detemriined future environment to determine 
a command, and generates the command; and further comprising an alarm capable of producing an alarm signal 
indicative of the selected one alert category in response to the command. 

18. The driving assist system as claimed in claim 15, wherein the first risk category (1/TTC) is a function of relative 
vehicle velocity (V^) and vehicle separation (D). 

19. The driving assist system as claimed in claim 15, wherein the second risk category (1/THW) is a function of vehicle 
separation (D) and one of velocities (V,, Vg) of the vehicles. 

20. The driving assist system as claimed in claim 15, wherein, in detennining future environment (RP), the controller 
weighs the first and second risk categories (1/TTC, 1/THW) differently with first and second parameters (a, b). 

21 . The driving assist system as claimed in claim 20, wherein the second risk category (1 /THW) is weighted less than 
the first risk category (1/TTC) is. 

22. The driving assist system as claimed in claim 21 , wherein the detennlned future environment (RP) is the sum of 
the weighted first and second risk categories (b/TTC, a/THW). 

23. The driving assist system as claimed in claim 21 , wherein the detennined future environment (RP) is the greater 
one of the weighted first and second risk categories (b/TTC, a/THW). 

24. A driving assist for assisting effort by an operator to operate a vehicle in traveling, the driving assist system com- 
prising: 

a data acquisition system acquiring data involving infomriation on the presence of a leading vehicle in a field 
around the vehicle; and 

a controller, mounted to the vehicle, for receiving the acquired data, for detennining an extent (1/TTC) to which 
the vehicles has approached to each other, for detennining a period of time (Xp) as a function of the determined 
extent (1/TTC) and for detennining afuture quantity of the extent (l/TTC) that would occur upon elapse of the 
period of time from the determined extent (1/TTC) to give future environment in the field (RP). 

25. The driving assist system as claimed in claim 24, wherein the controller makes an operator response plan in 
response to the determined future environment to determine a command and generates the command; and further 
comprising an accelerator reaction modulation actuator capable of modulating reaction characteristic to manual 
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effort applied onto an accelerator of the vehicle by the operator in response to the command. 

26 The driving assist system as claimed in claim 24, wherein the controller has various alert 'categories with dWerent 
I^virtrr^enfS eg^ries and selects one of the alert categories for the determined future environment to determine 
a cor^manS! and genSates the command; and further comprising an alarm capable of producing an alarm signal 
indicative of the selected one alert category in response to the command. 

27. The driving assist system as claimed in claim 24, wherein the period of time (Xp) is inversely proportional to the 
determined extent (1 /TTC) . 

28 The driving assist system as claimed in claim 15. wherein, in detem^ining future environment, t^e f ntroller c^^ 
lulatesTrisk perceived (RP) as a function of the first and second risk categories, and smoothes a difference 
heSeen a chanqr^^^^^ respect to a unit change in a time headway CTHW) between the vehicles when 

TxTe headway is ifs^ than a threshold THW value and a change of the RP wrth respect to the unrt change in 
the time headway when the time headway is greater than the threshold THW. 

''•""^^erwrrmeTer^^^ 

deteln^g future environment the controller calculates a risk perceived (RPo) as function of a ' '^st term (b/TTC) 

whrcr^proportional to the fii^t risk categonr (1/TTC) that is given by the reciprocal of a to 

be^een 5^ie vehicles, and a second term (amHW). which is proportional to the second nsk category (1 /THW) that 

'^ll^:r^n T^^^^^^ thl TnTs^greater than the threshold THW value, in detem^lning future enyironrnent, 
the oonCer c:teu,:tes a risk perceived (RP,) as a function of the ^'-^^^^J''^ J " 
which proportional to the second risk category that is given by a quantrty subtracted by the THW 

30. The ~tdrrn-rg f«^^ controller calculates a risk perceived (RP.) as a fun^ion of a 

first te?, (b^C) which is proportional to the first risk category (^/TTC) that is given by the reciprocal of a ^me 
trcorct (TTcVbetween the vehicles, a second term (1/THW). which corresponds to the s«<=°"f^"^^jc ^ 
(1/^HW)1hat is given by the reciprocal of a time headway (THW) between the vehicles and a thn^^^^ (c - THW). 
whTchTs proportional to the second risk category that is given by a 'SJ^r^^^ asecond 

and wherein, the function involves a first parameter (a) multiplied wnh thesecondtemi (imHW) and asecond 
parameter (d) multiplied with the third temn (c - THW); th«» thw 

and wherein, the controller sets the first and second parameters (a. d) in response to the THW 

The drivina assist svstem as claimed in claim 30, wherein the controller sets the first and second parameters (a, 
i LcZHe thirst;;; grows apparent in the function than the second term does as the THW increases. 

The driving assist system as claimed in claim 15, wherein, in detemiining future ^"Viror^ment^the contro^^^^^^^ 
culatesTrisk perceived (RP^) as a function of a first temi (bfUC). whteh is proportional to the ''^t^sk category 
n^C) that is g Jen by he eciprocal of a time to contact (TTC) between the vehicles, a second Xem {^m^N) 
l^h T^ipon^^^^^^ seconS risk category (1/THW) that is given by the reciprocal of « t^^^-^^^^^^^^^^^ 
beTeen the vehicles, and a third term (c - THW). which is proportional to the second risk category that is given 

' rd7he?e^;:respon*: tTe THW, the controller alters weighting components, which are imposed on the 
second term (l/THW) and the third term (c - THW). respectively 

old THW value, the controller sets 0 as the weight imposed on the second term (1 /THW) and sets 1 as the weigniing 
components imposed on the third term (c - THW). 

34 The driving assist system as claimed in claim 32, wherein, when the THW is not Q-ater than J^^^^^^^J^ T";,"^ 
value, the controller sets 1 as the weighting component imposed on the ^^^^^l^Ti^rd?^^^^^^^^ 
weighting component imposed on the third tern, (c - THW); and wherein. 

value the controller alters the weighting components imposed on the second temi (1/THW) and the third temn (c 
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- THW) such that as the THW increases, the weighting component imposed on the second temn (1/THW) reduces 
toward 0 from 1 , while the weighting component imposed on the thircl tenm (c - THW) increases from 0 toward 1 . 

35. The driving assist system as claimed in claim 28, wherein the first risk category (1/TTC) is a function of relative 
5 vehicle velocity (V^) and vehicle separation (D). 

36. The driving assist system as claimed In claim 28, wherein the controller makes an operator response plan in 
response to the detemnined future environment to determine a command and generates the command; and further 
comprising an accelerator reaction modulation actuator capable of modulating reaction characteristic to manual 

10 effort applied onto an accelerator of the vehicle by the operator in response to the command. 

37. The driving assist system as claimed in claim 28, wherein the controller has various alert categories with different 
environment categories and selects one of the alert categories for the detennined future environment to determine 
a command, and generates the command; and further comprising an alarm capable of producing an alarm signal 

15 indicative of the selected one alert category in response to the command. 

38. A driving assist system for assisting effort by an operator to operate a vehicle in traveling, the driving assist system 
comprising: 

20 a data acquisition system acquiring data involving information on the presence of an obstacle in a field around 

the vehicle; 

a controller, mounted to the vehicle, for receiving the acquired data, for determining a risk which the obstacle 
would cause the operator to perceive, for allocating commands for prompting the operator to operating the 
vehicle longitudinally and laterally, and for generating the commands; and 
25 a plurality of actuators, mounted to the vehicle, to prompt the operator in response to the commands to oper- 

ating the vehicle tongitudinaily and laterally. 

39. The driving assist system as claimed in claim 38, wherein the commands are applied to the plurality of actuators. 

30 40. The driving assist system as claimed in claim 39, wherein each of the plurality of actuators is capable of modulating 
reaction characteristic to manual effort by the operator. 

41. The driving assist system as claimed in claim 38, wherein the data acquisition system is mounted to the vehicle. 

35 42. The driving assist system as claimed in claim 38, wherein the controller uses a direction from the vehicle to the 
obstacle, a separation between the vehicle and the obstacle, and a relative velocity between the vehicle and the 
obstacle in determining a risk, which the obstacle would cause the operator to perceive. 

43. The driving assist system as claimed in claim 42, wherein the risk is a function of a time to contact (TTC) that is 
40 given by dividing the separation by the relative velocity. 

44. The driving assist system as claimed in claim 43, wherein the data acquisition system is mounted to the vehicle, 
and wherein the controller accounts for variance of the separation and variance of the relative velocity in deter- 
mining the TTC. 

45 

45. The driving assist system as claimed in claim 44, wherein the obstacle is classified into one of predetermined 
categories; and wherein the variances of separation and relative velocity with regard to the obstacle are subject 
to variation, in magnitude, with different categories, which the obstacle may be classified into, of the predetemnined 
categories. 

50 

46. The driving assist system as claimed in claim 44, wherein the data acquisition system includes a plurality sensors 
of different kinds, in performance, for sensing the obstacle; and wherein the variances of separation and relative 
velocity with regard to the obstacle are subject to variation, in magnitude, with different kinds, in performance, of 
sensors, whereby the obstacle may be sensed. 

55 

47. The driving assist system as claimed in claim 43, wherein the obstacle is classified into one of predetermined 
categories that are weighted differently, and wherein the controller accounts for how much the category, which the 
obstacle Is classified into, is weighted in determining the TTC that is used in detemiining the risk. 
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48 The drivinq assist system as claimed in claim 44. wherein the obstacle is classified into one of predetemn.ned 
I^ego^s thT^e we ghted differently, and wherein the controller accounts for how much the category. wh,ch the 
obScte is classified into, is weighted in detem,lr,ing the TTC that is used In detem^mng the nsk. 

49 The drivina assist system as claimed in claim 46. wherein the obstacle is classified into one of predetermined 

obstacle is classified into, is weighted in detemiining the TTC that .s used in detemiinmg the nsk. 

51 The drMng assist system as claimed in claim 42. wherein, in making an operator response P'^"^f*;;^°^^^^^^ 
■ divtjes the detemiined risk into a longitudinal, with respect to the vehicle, nsk component and a lateral, « * respert 
^ ^rveWcle rS: component, uses the longitudinal risk component to determine the amount of mpu to one of 
a?uatoTand uses the lateral risk component to detemiine the amount of input to another of the 

plurality of actuators. 

and a change of manual effort by the operator in operating the vehicle laterally. 
53. A driving assist system tor assisting effort by an operator to operate a vehicle In traveling, the driving assist system 
comprising: 

a data acquisition system acquiring data involving infomiation on the presence of obstacles in a field around 

TcomSilr mounted to the vehicle, for receK^ing the acquired data, tor detemiining a risk which each of the 
LstSsluldcausetheoperatortoperceive.tormakinganoperatorresponseplan.nresponsetothen^^^^ 

prompts the operator to operating the vehicle longitudinally and laterally, to determine commands. 

ating the vehicle longitudinally and laterally. 

54 The driving assist system as claimed in claim 38, wherein one of the plurality of actuators is capable of modulating 
reaction characteristic to manual effort applied onto an accelerator of the vehicle by the operator 

55 The driving assist system as claimed in claim 38, wherein one of the plurality of actuators is capable of modulating 
reacSon characteristic to manual effort applied onto a brake of the vehicle by the operator 

56. The driving assist system as claimed in claim 38. wherein one of the plurality of actuators is capable of modulating 
reaction characteristic to manual steering effort by the operator. 

57. Adrivingassist system tor assisting effort by an operatortooperateavehicle in traveling, the driving assist system 

comprising: 

a data acquisition system, mounted to the vehicle, acquiring data involving infomiallon on the presence of an 

fi"ttiL7r::red^ 

w^d^useThe operator to perceive using a direction from the vehicle to the obstacle, a «f P^^f °" '^^^^^^^^ 
The vehic^ and the obstacle and a relative velocity between the vehicle and the obstacle for allocating com- 
r^Lds tor prCt^g the operator to operating the vehicle tongKudinally and laterally, and tor generating the 

TpTuTaTty' of a'^'uators. mounted to the vehicle, to prompt the operator in response to the commands to oper- 

chaSS^ctomanual effort appliedonto an acceleratorofthevehiclebytheoperaton^a 

modSon rJtuator capable of modulating reaction characteristic to manual effort applied onto a brake of the 
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vehicle by the operator, and a steering reaction modulation actuator capable of modulating reaction charac- 
teristic to manual steering effort by the operator. 

58. A driving assist system for assisting effort by an operatorto operate a vehicle in traveling, the driving assist system 
5 comprising: 

a data acquisition system, mounted to the vehicle, acquiring data involving information on the presence of 
obstacles in a field around the vehicle; 

a controller, mounted to the vehicle, for receiving the acquired data, for determining a risk which each the 
obstacles would cause the operator to perceive using a direction from the vehicle to the obstacle, a separation 
between the vehicle and the obstacle, and a relative velocity between the vehicle and the obstacle, for making 
an operator response plan in response to the risk, which plan prompts the operator to operating the vehicle 
longitudinally and laterally, to determine commands, and for generating the commands; and 
a plurality of actuators, mounted to the vehicle, to prompt the operator in response to the commands to oper- 
ating the vehicle longitudinally and laterally, 

wherein, in making an operator response plan, the controller divides each the determined risks into a longi- 
tudinal with respect to the vehicle, risk component and a lateral, with respect to the vehicle, risk component, uses 
the total of the longitudinal risk components to determine the amount of input to one of the plurality of actuators, 
20 and uses the total of the lateral risk components to determine the amount of input to another of the plurality of 

actuators. 

59. The driving assist system as claimed in claim 58, wherein the risk which each the obstacles would cause the 
operator to perceive is a function of a time to contact (TTC) between the vehicle and the obstacle. 

25 

60. A driving assist system for assisting effort by an operatorto operate a vehicle in traveling, the driving assist system 
comprising: 

means for acquiring data involving infonnation on the presence of obstacles in a field around the vehicle; 
means for determining a risk which each the obstacles would cause the operatorto perceive using a direction 
from the vehicle to the obstacle, a separation between the vehicle and the obstacle, and a relative velocity 
between the vehicle and the obstacle 

means for dividing each the detemiined risks into a longitudinal, with respect to the vehicle, risk component 
and a lateral, with respect to the vehicle, risk component; 

means for calculating the total of the longitudinal risk components and the total of the lateral risk components; 
means for making an operator response plan in response to the calculated totals, which plan prompts the 
operatorto operating the vehicle longitudinally and laterally, to determine commands; and 
means for prompting the operator in response to the commands to operating the vehicle longitudinally and 
laterally. 

61. A vehicle operated by an operator in traveling, the vehicle comprising: 

a data acquisition system acquiring data including information on vehicle state and information on environment 
in a field around the vehicle; 

a controller for detemnining future environment in the field using the acquired data, for making an operator 
response plan in response to the determined future environment, which plan prompts the operator to operating 
the vehicle in a desired manner for the determined future environment, to determine command, and for gen- 
erating the command; and 

at least one actuator for prompting the operator in response to the command to operating the vehicle in the 
desired manner. 

62. A vehicle operated by an operator in traveling, the vehicle comprising: 

a data acquisition system acquiring data including information on vehicle state and information on environment 
55 in a field around the vehicle, the information on environment involving information on the presence of obstacles 

in the field; 

a controller for receiving the acquired data, for determining future environment in the field, the determined 
future environment involving a risk which each of the obstacles would cause the operator to perceive, for 
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making an operator response plan in response to the determined future environment, which plan Pr°J"Pts 
Operator to operating the vehicle at least longitudinally to reduce the risks, to determ.ne commands, and for 

r^^S'of—t prompting the operator In response to the commands to operating the vef.c^^^^ at 
feSStudinally. the piu^ of actuators includes an accelerator reaction '-^f^^f^^^^^'^'"'^''^''^ 
modulating reaction characteristic to manual effort applied onto an accelerator of the vehicle. 

63. A vehicle operated by an operator in traveling, the vehicle comprising: 

a data acquisition system acquiring data involving infomiation on the presence of an obstacle in a field around - 

TS^iicr receiving the acquired data, for determining a risk which the obstacle would cause the operator 
To peJSle, for allocat^ commands for prompting the operator to ope-ating the vehicle longrtud.nalhr and 

LTitraXni^^^^^^^^ 

ating the vehicle longitudinally and laterally. 

64. A vehicle operated by an operator in traveling, the vehtole comprising: 

a data acquisition system acquiring data involving infomiation on the presence of obstacles in a field around 

Tcom^Se'; for receiving the acquired data, for detemiining a risk which each of the obstacles wo" Id cause 
the opermorto perceive for making an operator response plan in response to the risks. ^^^-^ P 3°^P^^ 
the operator to operating the vehicle longitudinally and laterally, to detemi.ne commands, and for generating 

rpl'aTottctuators to prompt the operator in response to the commands to operating the vehicle longitu- 
dinally and laterally. 

65. A vehicle operated by an operator in traveling, the vehicle comprising: 

a data acquisition system acquiring data Involving information on the presence of an obstacle in a f ield around 

a coml!!»eMor receiving the acquired data, for detemiining a risk which the obstacle would cause the operator 
ToperceLersn^adS^^ 

and a rSve velocity between the vehicle andthe obstacle, formaking an operator response p an ,n response 
to fhe^Hhlclf plan prompts the operator to operating the vehicle longrtudinally and laterally, to detem^ne 

r;uT^^airr:^^^^^^^^ 

tTelrXoSators including an accelerator reaction modulation actuator capable of modulating reacticn 
characte istte to manual effon applied onto an accelerator of the vehicleby the operator, a brake P^dal react on 
moSoSulTc^^^^^ of r^odulating reactton characteristic to manual effort applied onto a brake of the 
TmcLTthe op^^^^^^^ a steering reaction modulation actuator capable of modulating reaction charac- 
teristic to manual steering effort by the operator. 

66. A vehicle operated by an operator in traveling, the vehicle comprising: 

a data acquisition system acquiring data involving infomiation on the presence of obstacles in a field around 

TcontlSer for receiving the acquired data, for detem^lning a risk which each the obstacles ^-l'^ c«use the 
oper^ to perceive us^^g a direction from the vehtele to the obstacle, a separation between the je^ic^^^^^^^^^ 
the ot^stacle and a relative velocity between the vehicle and the obstacle, for making an operator response 
p'LTn re^onse'o the risk. Which pL prom 
tft determine commands, and for generating the commands; and 

:PZ oi actulrs to prompt t'he operator in response to the commands to operating the vehicle long.tu- 
dinally and laterally. 

wherein, in making an operator response plan, the controller dMdes each the determined risks into a longi- 
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tudinal with respect to the vehicle, risk component and a lateral, with respect to the vehicle, risk component, uses 
the total of the longitudinal risk components to determine the amount of Input to one of the plurality of actuators, 
and uses the total of the lateral risk components to detemnine the amount of input to another of the plurality of 
actuators. 

67. A method for assisting effort by an operator to operate a vehicle in traveling, the method comprising: 

acquiring data including infomnation on vehicle state and infomnation on environment in a field around the 
vehicle; 

determining future environment in the field using the acquired data; 

making an operator response plan in response to the detemnined future environment, which plan prompts the 
operator to operating the vehicle in a desired manner for the determined future environment, to determine 

command; and 

prompting the operator in response to the command to operating the vehicle in the desired manner. 

68. A method for assisting effort by an operator to operate a vehicle In traveling, the method comprising: 

acquiring data including information on vehicle state and Information on environment in a field around the 
vehicle, the information on environment involving information on the presence of obstacles in the field; 
determining future environment in the field based on the acquired data, the determined future environment 
involving a risk which each of the obstacles would cause the operator to perceive; 

making an operator response plan in response to the determined future environment, which plan prompts the 
operator to operating the.vehicle at least longitudinally to reduce the risks, to detennine commands; and 
prompting the operator In response to the commands to operating the vehicle at least longitudinally, by mod- 
ulating reaction characteristic to manual effort applied onto an accelerator of the vehicle. 

69. A method for assisting effort by an operator to operate a vehicle in traveling, the method comprising: 

acquiring data involving information on the presence of a leading vehicle in a field around the vehicle; and 
determining, based on the acquired data, a reciprocal (1/TTC) of a time to contact (TTC) between the vehicles; 
determining, based on the acquired data a reciprocal (1/THW) of a time headway between the vehicles; 
determining future environment (RP) in the field based on the determined reciprocals (l/TTC, 1/THW); 
making an operator response plan in response to the determined future environment to determine a command; 
and 

modulating reaction characteristic to manual effort applied onto an accelerator of the vehicle in response to 
the command. 

70. A method for assisting effort by an operator to operate a vehicle in traveling, the method comprising: 

acquiring data involving infomnation on the presence of a leading vehicle in a field around the vehicle; and 
determining, based on the acquired date, an extent (1/TTC) to which the vehicles has approached to each 
other; 

determining a period of time (Xp) as a function of the determined extent (1/TTC); 

determining a future quantity of the extent (1/TTC) that would occur upon elapse of the period of time from 
the detemnined extent (1/TTC) to give future environment in the field (RP); 

making an operator response plan In response to the determined future environment to determine a command; 
and 

modulating reaction characteristic to manual effort applied onto an accelerator of the vehicle by the operator 
in response to the command. 

71 . A method for assisting effort by an operator to operate a vehicle in traveling, the method comprising: 

acquiring data involving infomnation on the presence of an obstacle in a field around the vehicle; 
determining, out of the acquired data, a risk which the obstacle would cause the operator to perceive; 
allocating commands for prompting the operator to operating the vehicle longitudinally and laterally; and 
prompting the operator in response to the commands to operating the vehicle longitudinally and laterally. 

72. A method for assisting effort by an operator to operate a vehicle in traveling, the method comprising: 
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acauirinq data involving information on the presence of obstacles in a field around the vehicle, 
Se ling out of the acquired data, a risk which each of the obstacles would cause the operator to perceive; 
mS an operator response plan in response to the risks, which plan prompts the operator to operat.ng the 
vehicle longitudinally and laterally, to determine commands; and . ^. „ ^ ,».„„ii„ 

prompting the operator in response to the commands to operating the vehicle longrtud.nally and laterally, 

A method for assisting effort by an operator to operate a vehicle In traveling, the method comprising: 

acquiring data involving information on the presence of obstacles in a field around the vehicle; 
dSeSing out of the acquired data, a risk which each of the obstacles would cause the operator to perce«,e 
uSng a direction from the vehicle to the obstacle, a separation between the vehicle and the obstacle, and a 
relative velocitv between the vehicle and the obstacle; 

miking an operator response plan in response to the risks, which plan prompts the operator to operat.ng the 
vehicle lonaitudinallv and laterally, to determine comnnands; 

mo<irurati^^^^^^^^^ to manual effort applied onto an accelerator of the vehicle by the operator 

in response to one of the commands; 

modulating reaction characteristic to manual effort applied onto a brake of the vehicle by the operator m re- 
SDonse to another of the commands; and 

modulating reaction characteristic to manual steering effort by the operator in response to other of the com- 

mands. 

. The method as claimed in claim 73. wherein the step of making an operator response plan comprises the sub- 

Steps of: 

dividing each the determined risks into a longitudinal, with respect to the vehicle, risk component and a lateral, 
with respect to the vehicle, risk component; and 

cZuJr.g the total of the longitudinal risk components and the total of the lateral risk components in deter- 
mining the commands. 
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THW : TIME HEADWAY 

D : VEHICLE SEPARATION 
v. : VELOCITY OF LEADING VEHICLE 
Vf : VELOCITY OF FOLLOWING VEHICLE 
V| - Va : RELATIVE VEHICLE VELOCITY 
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